-- Logs begin at Mon 2022-07-25 20:36:10 UTC, end at Mon 2022-07-25 21:58:22 UTC. -- Jul 25 21:23:44.943890 dv-osbrick-849018-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 21:23:44.952980 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 21:23:44.955043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 21:23:44 2022] *** Jul 25 21:23:44.955043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 21:23:44.955043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 21:23:44.955043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: nodename: dv-osbrick-849018-3-iscsi Jul 25 21:23:44.955043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: machine: x86_64 Jul 25 21:23:44.955043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: clock source: unix Jul 25 21:23:44.955043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: pcre jit disabled Jul 25 21:23:44.955043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: detected number of CPU cores: 4 Jul 25 21:23:44.955043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: current working directory: / Jul 25 21:23:44.955043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: detected binary path: /usr/bin/uwsgi-core Jul 25 21:23:44.955043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: your processes number limit is 47680 Jul 25 21:23:44.955664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: your memory page size is 4096 bytes Jul 25 21:23:44.955664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: detected max file descriptor number: 2048 Jul 25 21:23:44.955664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: lock engine: pthread robust mutexes Jul 25 21:23:44.955664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: thunder lock: enabled Jul 25 21:23:44.955664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 21:23:44.955664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 21:23:44.996178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: Python main interpreter initialized at 0x564ab07979c0 Jul 25 21:23:44.996178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: python threads support enabled Jul 25 21:23:44.996178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: your server socket listen backlog is limited to 100 connections Jul 25 21:23:44.996178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: your mercy for graceful operations on workers is 90 seconds Jul 25 21:23:44.996547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 21:23:44.996617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: *** Operational MODE: preforking *** Jul 25 21:23:44.996869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: *** uWSGI is running in multiple interpreter mode *** Jul 25 21:23:44.996869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: spawned uWSGI master process (pid: 80295) Jul 25 21:23:44.997076 dv-osbrick-849018-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 25 21:23:44.998967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: spawned uWSGI worker 1 (pid: 80307, cores: 1) Jul 25 21:23:44.998967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: spawned uWSGI worker 2 (pid: 80308, cores: 1) Jul 25 21:23:44.998967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80295]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 21:23:50.574542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 21:23:50.574542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: from cryptography.utils import int_from_bytes Jul 25 21:23:50.575316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 21:23:50.575316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: from cryptography.utils import int_from_bytes Jul 25 21:23:50.575429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 21:23:50.575429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: from cryptography.utils import int_from_bytes Jul 25 21:23:50.575875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 21:23:50.575875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: from cryptography.utils import int_from_bytes Jul 25 21:23:50.626483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 21:23:50.626678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 21:23:50.626859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] command line args: [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 21:23:50.627130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 21:23:50.627214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 21:23:50.627293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ================================================================================ {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 21:23:50.627511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 21:23:50.627636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] admin_token = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.627724 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] command line args: [] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 21:23:50.627841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] config_dir = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.627915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 21:23:50.627988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.628057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ================================================================================ {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 21:23:50.628216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] config_source = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.628315 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] admin_token = **** {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.628387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] debug = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.628533 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.628801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] config_dir = [] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.628801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.629022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] config_source = [] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.629221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] debug = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.629441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.629555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.629690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.629778 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.629891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.630018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.630141 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.630231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.630411 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.630494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] list_limit = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.630611 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] list_limit = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.630695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] log_config_append = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.630805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] log_config_append = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.630894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.630958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.631021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] log_dir = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.631144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] log_dir = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.631227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] log_file = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.631291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] log_file = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.631440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.631571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.631699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.631866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.632004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.632131 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.632267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.632393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.632518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.632652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.632785 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.632915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.633073 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.633205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.633325 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.633457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.633580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.633713 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.633835 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.633961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.634088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.634225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.634353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.634487 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.634616 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.634698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.634813 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.634936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.635065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.635195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.635332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.635455 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.635641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] publish_errors = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.635783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] publish_errors = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.635861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.635981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.636070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.636147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.636216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.636284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.636356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.636448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.636526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.636649 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.636723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] standard_threads = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.636843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] standard_threads = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.636929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.637008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.637078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.637146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.637219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.637293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.637361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] use_journal = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.637436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] use_journal = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.637511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] use_json = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.637580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] use_json = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.637654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] use_stderr = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.637727 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] use_stderr = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.637802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] use_syslog = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.637946 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] use_syslog = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.638018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.638086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 21:23:50.638239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.638317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.638476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.638564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.638733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.638810 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.638968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.639049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.639212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.639298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.639446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.639522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.639690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.639806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.639947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.640032 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.640190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.640265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.640430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.640510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.640677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.640754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.640908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.640989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.641149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.641225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.641382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.641462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.641622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.641706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.641863 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.641947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.642096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.642179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.642344 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.642420 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.642592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.642667 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.642830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.642907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.643060 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.643134 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.643307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.643382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.643564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.643642 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.643833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.643913 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.644079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.644156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.644307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.644384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.644738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.644848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.644946 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.645065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.645152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.645318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.645400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.645570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.645646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.645818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.645902 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.646045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.646121 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.646273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.646354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.646518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.646594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.646751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.646823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.646988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.647059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.647215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.647288 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.647450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.647517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.647681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.647822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.647932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.648008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.648173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.648259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.648383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.648459 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.648608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.648685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.648832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.648907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.649066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.649151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.649297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.649385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.649529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.649613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.649755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.649831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.649982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.650059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.650213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.650296 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.650442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.650515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.650675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.650759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.650900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.650978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.651133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.651214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.651368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.651448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.651604 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.651685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.651859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.651938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.652086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653025 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653025 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653207 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653789 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.653997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.654120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.654188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.654256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.654332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.654403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.654580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.654657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.654818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.654895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.655040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.655112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.655275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.655352 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.655506 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.655584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.655765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.655845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.655991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.656067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.656226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.656303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.656461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.656553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.656697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.656773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.656932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.657010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.657164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.657247 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.657393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.657470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.657621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.657697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.657851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.657936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.658080 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.658163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.658329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.658405 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.658570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.658657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.658805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.658884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.659040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.659116 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.659272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.659357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.659506 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.659582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.659749 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.659837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.660492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.660626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.660870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.661188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.661271 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.661431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.661521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.661661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.661992 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.662145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.662222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.662384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.662461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.662618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.662702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.662862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.662938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.663097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.663174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.663348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.663436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.663602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.663684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.663862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.663942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.664091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] auth.external = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.664169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] auth.external = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.664318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.664437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.664610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.664715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.664839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.664919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.665067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] auth.password = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.665145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] auth.password = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.665298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] auth.token = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.665433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] auth.token = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.665540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.665675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.665760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.665845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.665997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.666076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.666224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.666301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.666467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.666546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.666709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.666786 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.666937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.667015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.667168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] credential.caching = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.667247 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] credential.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.667467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.667550 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.667642 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.667730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.667909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.667989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.668143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.668220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.668385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.668478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.668613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.668690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.668876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.668964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.669127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.669213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.669358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.669436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.669606 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.669682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.669884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.670038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.670113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.670172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.670373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.670512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.670611 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.670715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.670849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.670955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.671080 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.671185 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] federation.caching = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.671313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.671426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.671557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.671663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.671806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.671910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.672041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.672155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.672282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.672388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.672516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.672628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.672763 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.672876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.672993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.673145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.673251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.673349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.673445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.673549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.673689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.673802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.673922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.674026 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity.caching = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.674163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.674276 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.674405 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.674509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.674634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.674739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.674864 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.674985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.675106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.675209 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.675336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.675447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.675586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.676304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.676497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.676786 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.676984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.677065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.677216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.677307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.677449 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.677529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.677691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.677777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.677937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.678026 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.678182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.678261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.678430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.678510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.678672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.678751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.678926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.679004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.679173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.679253 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.679408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.679487 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.679637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.679722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.679896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.679979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.681729 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.681861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.681939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682080 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682150 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682150 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682288 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682359 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.682981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.683061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.683134 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.683204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.683273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.683343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.683412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.683490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.683562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.683632 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.683702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.683834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.683907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.683990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.684064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.684157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.684229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.684299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.684368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.684446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.684518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.684586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.684656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.684725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.684800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.684879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.684951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.685085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.685165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.685317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.685424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.685547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.685623 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.685792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.685870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.686036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.686114 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.686266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.686345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.686496 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.686575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.686726 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.686804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.686954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.687035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.687190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.687270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.687431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.687508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.687664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.687762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.687930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.688010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.688161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.688239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.688388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.688468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.688620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.688697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.688847 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.688925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.689078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.689186 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.689304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.689409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.689543 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.689652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.689759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.689971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.690082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.690180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.690276 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.690381 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.690480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.690582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.690806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.690912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.691051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.691175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.691343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.691450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.691660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.692048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.692157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.692297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.692404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.692537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.692642 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.692777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.692882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.693017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.693123 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.693261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.693365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.693473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.693725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.693850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.693926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.693998 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.694075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.694147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.694225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.694379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.694458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.694622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.694700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.694851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.694936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.695079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.695157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.695317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.695396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.695553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.695640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] resource.caching = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.695809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.695893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.696047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.696127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.696286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.696378 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.696531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.696608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.696772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.696849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.697003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.697090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.697248 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.697326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.697481 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.697558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.697716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.697802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.697947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] role.caching = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.698024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.698182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.698259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] role.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.698409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.698495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.698640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] role.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.698717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.698882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] role.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.698962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.699110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.699197 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.699356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.699435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.699597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.699676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.699859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.700046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.700124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.700194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.700336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.700416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.700567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.700655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.700808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.700886 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.701049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.701127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.701278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.701364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.701521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.701600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.701764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.701944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.702031 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.702176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.702256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.702422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.702650 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.702730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.702884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.702964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.703129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.703206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.703362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.703441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.703603 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.703682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.703873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.703953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.704112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.704190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.704344 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.704424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.704572 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.704650 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.704801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.704879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.705042 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.705121 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.705271 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.705351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.705499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.705578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.705747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.705827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.705977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.706054 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.706207 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.706288 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.706439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] token.caching = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.706519 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.706668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.706745 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.706928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.707035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.707367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.707624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.707713 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] token.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.707908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.707990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.708147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.708241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.708393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.708472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.708635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.708713 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.708883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.709003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.709104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.709201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.709336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.709440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.709568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.709680 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.709809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.709912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.710042 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.710147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.710253 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.710369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.710476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.710581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.710725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.710836 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.711015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.711136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.connection = **** {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.711255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.711372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.711488 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.711628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.711720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.711850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.711938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.712011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.connection = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.712172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.712260 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.712408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.712488 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.712643 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.712857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.712857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.712991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.713099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.713180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.713330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.713416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.713562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.713639 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.713791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.713869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.714033 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.714118 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.714264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.714342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.714506 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.714584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.714730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.714816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.714968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.715047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.715199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.715281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.715352 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 21:23:50.715432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.715656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.715920 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.716154 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 21:23:50.716322 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 21:23:50.745271 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.745500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.745720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.748403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.748636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.748860 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.755081 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.761657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.786133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.786351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.791325 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.791556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.838518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.839989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.889787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.890015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.891388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.891623 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.954392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.954615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.954836 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.955053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.955156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.955270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.955353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.955483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.955567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.955729 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.955965 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.956177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.978545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.978776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.978951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.979039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.979182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.979267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.979404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.979488 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.979614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.979698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.979859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.979942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.980075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.980287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.991278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:50.991968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.004421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.004654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.004878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.005225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.005315 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.005452 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.005536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.005677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.005770 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.005900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.005983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80308) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.006117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.006330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.006540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 21:23:51.022781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.022985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 21:23:51.023316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.023475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.023581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 21:23:51.023688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 21:23:51.023792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.024042 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.024124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.024237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 21:23:51.024339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.024503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.024589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.024756 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.025009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.025259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.034146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.034415 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.034676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.035067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.039634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.039932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.040196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.042760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.042843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.047486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.047779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.048065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.048326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.048595 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.048847 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.049105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.049374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.049636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.049734 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.049902 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.050160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.055390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.055665 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.055967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.056246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.056523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.056784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.057047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.057313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.057575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.057843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.058102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.074019 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.075492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.075783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.080357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.080634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.080913 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.083661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.085172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.085448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.087502 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.097053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.097143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.097143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.097143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.097304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.097304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.097304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.097304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.097304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.097304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.097651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.097651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.097771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.097771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.102520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.102810 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.103093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.103369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.103637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.103947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.104210 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.104486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.110839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.111091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.115594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.118735 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.119027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.121341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.121614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.123367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.125542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.126526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.129278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.129988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.130265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.130558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.130833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.131113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.131384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.131665 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.134349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.137528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.140878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.141173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.141454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.141744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.142025 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.142306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.147609 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.147908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.148171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.148428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.155238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.156799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.157068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.158747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.159025 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.159286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.159542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.160411 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.160749 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.161041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.161313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.161593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.167641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.169199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.169470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.172284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.172561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.172845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.173145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.173239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.173413 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.173511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.173708 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.173982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.174254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.174521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.174787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.186896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.187167 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.187442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.187712 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.188009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.188275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.188539 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.191053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.194134 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.197091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.199531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.201141 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.201435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.201710 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.204542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.208045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.208138 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.209712 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.210972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.212621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.212915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.213201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.213439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.213521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.214932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.215213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.215492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.221422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.221754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.221934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.222018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.224513 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.227410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.227698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.227995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.228262 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.229385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80308) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.229657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.229928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.230193 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.230467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.230737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.230999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.231257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.231628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.231925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.232205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.232469 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.232726 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80308) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.236272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.236551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.236833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.244742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 21:23:51.245017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.245293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.245566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.245850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.246116 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.246383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.246659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.247027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.247305 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.247594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.247899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.248163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.248419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 21:23:51.266417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ab07979c0 pid: 80308 (default app) Jul 25 21:23:51.269924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6688-3870-4f0e-bbb3-7ff3091d1919 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:51.270262 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6688-3870-4f0e-bbb3-7ff3091d1919 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:51.270537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6688-3870-4f0e-bbb3-7ff3091d1919 None None] PATH_INFO: `/v3` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:51.274784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Mon Jul 25 21:23:51 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:23:51.282579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ab07979c0 pid: 80307 (default app) Jul 25 21:23:59.820063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc523ef-c041-4212-98d3-3d81eab5ba03 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:59.820610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc523ef-c041-4212-98d3-3d81eab5ba03 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:59.820610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc523ef-c041-4212-98d3-3d81eab5ba03 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:59.821973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:23:59.829458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943051f-8df6-40f1-b456-35db2bb47d04 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:23:59.829864 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943051f-8df6-40f1-b456-35db2bb47d04 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:23:59.830024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943051f-8df6-40f1-b456-35db2bb47d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:23:59.902653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: INFO dbcounter [None req-a943051f-8df6-40f1-b456-35db2bb47d04 None None] Registered counter for database keystone Jul 25 21:23:59.924096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG oslo_db.sqlalchemy.engines [None req-a943051f-8df6-40f1-b456-35db2bb47d04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 21:23:59.930904 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writer thread running {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 21:24:00.119959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG passlib.handlers.bcrypt [None req-a943051f-8df6-40f1-b456-35db2bb47d04 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80307) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 21:24:00.202528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG passlib.handlers.bcrypt [None req-a943051f-8df6-40f1-b456-35db2bb47d04 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80307) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 21:24:00.202528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a943051f-8df6-40f1-b456-35db2bb47d04 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:00.202528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a943051f-8df6-40f1-b456-35db2bb47d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:00.306979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 1/3] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:23:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 25 21:24:00.434425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc523ef-c041-4212-98d3-3d81eab5ba03 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:00.503719 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: INFO dbcounter [None req-4bc523ef-c041-4212-98d3-3d81eab5ba03 None None] Registered counter for database keystone Jul 25 21:24:00.523310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG oslo_db.sqlalchemy.engines [None req-4bc523ef-c041-4212-98d3-3d81eab5ba03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80308) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 21:24:00.529408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writer thread running {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 21:24:00.649216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc523ef-c041-4212-98d3-3d81eab5ba03 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:00.653495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d3231-d6e0-4994-a99e-f064f6dbacfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:00.654136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d3231-d6e0-4994-a99e-f064f6dbacfc admin admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:00.654422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d3231-d6e0-4994-a99e-f064f6dbacfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:00.654701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d3231-d6e0-4994-a99e-f064f6dbacfc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:00.663724 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d3231-d6e0-4994-a99e-f064f6dbacfc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:00.715028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7a5d3231-d6e0-4994-a99e-f064f6dbacfc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 21:24:00.715375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d3231-d6e0-4994-a99e-f064f6dbacfc admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:00.726547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 3/4] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Jul 25 21:24:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:24:00.732508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943051f-8df6-40f1-b456-35db2bb47d04 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:00.747039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943051f-8df6-40f1-b456-35db2bb47d04 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:00.751491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107d447-19ce-4014-b186-f0e95606d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:00.752620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107d447-19ce-4014-b186-f0e95606d89a admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:00.752909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107d447-19ce-4014-b186-f0e95606d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:00.753184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107d447-19ce-4014-b186-f0e95606d89a admin admin] PATH_INFO: `/v3/projects/e47334e4e95e4979a35529036ec99feb` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:00.754798 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107d447-19ce-4014-b186-f0e95606d89a admin admin] RBAC: Authorizing `identity:get_project(project_id=e47334e4e95e4979a35529036ec99feb)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:00.805646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9107d447-19ce-4014-b186-f0e95606d89a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 21:24:00.805981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107d447-19ce-4014-b186-f0e95606d89a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:00.810542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 2/5] 10.222.0.27 () {56 vars in 1207 bytes} [Mon Jul 25 21:24:00 2022] GET /identity/v3/projects/e47334e4e95e4979a35529036ec99feb => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:02.782690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ddc43-760f-49b7-8968-ee3323636359 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:02.783218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ddc43-760f-49b7-8968-ee3323636359 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:02.783218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ddc43-760f-49b7-8968-ee3323636359 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:02.787702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 4/6] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:02.793151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cf1a5-bb78-4081-bb68-3b67f82de981 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:02.793557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cf1a5-bb78-4081-bb68-3b67f82de981 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:02.793717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cf1a5-bb78-4081-bb68-3b67f82de981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:02.814218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-675cf1a5-bb78-4081-bb68-3b67f82de981 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:02.815763 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-675cf1a5-bb78-4081-bb68-3b67f82de981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:02.824286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 3/7] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 21:24:02.845800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ddc43-760f-49b7-8968-ee3323636359 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:02.857925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ddc43-760f-49b7-8968-ee3323636359 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:02.862052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd18c9f-0f6b-40e1-ad5d-e3e296bdd898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:02.862650 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18c9f-0f6b-40e1-ad5d-e3e296bdd898 admin admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:02.862930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18c9f-0f6b-40e1-ad5d-e3e296bdd898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:02.863203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd18c9f-0f6b-40e1-ad5d-e3e296bdd898 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:02.871883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd18c9f-0f6b-40e1-ad5d-e3e296bdd898 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:02.873633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd18c9f-0f6b-40e1-ad5d-e3e296bdd898 admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:02.883326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 5/8] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Jul 25 21:24:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:24:02.888536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cf1a5-bb78-4081-bb68-3b67f82de981 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:02.897626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cf1a5-bb78-4081-bb68-3b67f82de981 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:02.902056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7394f1-d3fe-4f94-b513-848c95a741de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:02.902683 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7394f1-d3fe-4f94-b513-848c95a741de admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:02.902972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7394f1-d3fe-4f94-b513-848c95a741de admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:02.903254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7394f1-d3fe-4f94-b513-848c95a741de admin admin] PATH_INFO: `/v3/users/21d88c6eac2e460ca7e17f398e2ce9da` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:02.904631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7394f1-d3fe-4f94-b513-848c95a741de admin admin] RBAC: Authorizing `identity:get_user(user_id=21d88c6eac2e460ca7e17f398e2ce9da)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:02.906468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7394f1-d3fe-4f94-b513-848c95a741de admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:02.908055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 4/9] 10.222.0.27 () {56 vars in 1198 bytes} [Mon Jul 25 21:24:02 2022] GET /identity/v3/users/21d88c6eac2e460ca7e17f398e2ce9da => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:04.973822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afba33-d040-42ab-a977-aaa8fc038b4e None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:04.974822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afba33-d040-42ab-a977-aaa8fc038b4e None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:04.975348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afba33-d040-42ab-a977-aaa8fc038b4e None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:04.976721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:24:04.981823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c276a2f-bebb-4a7d-828c-ed0d96bf8ef3 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:04.982295 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c276a2f-bebb-4a7d-828c-ed0d96bf8ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:04.982435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c276a2f-bebb-4a7d-828c-ed0d96bf8ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:04.993146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fff2c-31b0-4ab1-9848-c6f426a5c479 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:04.993434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fff2c-31b0-4ab1-9848-c6f426a5c479 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:04.993713 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fff2c-31b0-4ab1-9848-c6f426a5c479 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:04.995014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 7/11] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:04.999933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4991a9-e745-40e2-916e-bb9b8b095a74 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:05.000226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4991a9-e745-40e2-916e-bb9b8b095a74 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:05.000506 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4991a9-e745-40e2-916e-bb9b8b095a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:05.003108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6c276a2f-bebb-4a7d-828c-ed0d96bf8ef3 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:05.004317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6c276a2f-bebb-4a7d-828c-ed0d96bf8ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:05.042970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG passlib.handlers.bcrypt [None req-ae4991a9-e745-40e2-916e-bb9b8b095a74 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80308) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 21:24:05.043391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG passlib.handlers.bcrypt [None req-ae4991a9-e745-40e2-916e-bb9b8b095a74 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80308) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 21:24:05.085481 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 5/12] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:05.088779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-ae4991a9-e745-40e2-916e-bb9b8b095a74 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:05.090385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-ae4991a9-e745-40e2-916e-bb9b8b095a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:05.108783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c276a2f-bebb-4a7d-828c-ed0d96bf8ef3 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:05.134311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:05.191810 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 8/13] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:24:05.215391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4991a9-e745-40e2-916e-bb9b8b095a74 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:05.216094 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c276a2f-bebb-4a7d-828c-ed0d96bf8ef3 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:05.249697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d928eb-0f71-419f-9750-7b744ffc5a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:05.250274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d928eb-0f71-419f-9750-7b744ffc5a86 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:05.250561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d928eb-0f71-419f-9750-7b744ffc5a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:05.250840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d928eb-0f71-419f-9750-7b744ffc5a86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:05.262608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d928eb-0f71-419f-9750-7b744ffc5a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-21d928eb-0f71-419f-9750-7b744ffc5a86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:05.271612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:05.272628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:05.273706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:05.273706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:05.273706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:05.273706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:05.273706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:05.273706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:05.273706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:05.273706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:05.273706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:05.273706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:05.273706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:05.273706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:05.273706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 6/14] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:24:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:24:05.278581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d928eb-0f71-419f-9750-7b744ffc5a86 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:05.315222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4991a9-e745-40e2-916e-bb9b8b095a74 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:05.317496 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:05.353908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80d23e-4c3f-453f-a196-635c0c384f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:05.354808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80d23e-4c3f-453f-a196-635c0c384f85 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:05.355102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80d23e-4c3f-453f-a196-635c0c384f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:05.355384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80d23e-4c3f-453f-a196-635c0c384f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:05.365293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:05.392507 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d928eb-0f71-419f-9750-7b744ffc5a86 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:05.429366 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80d23e-4c3f-453f-a196-635c0c384f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:05.431385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80d23e-4c3f-453f-a196-635c0c384f85 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:05.433550 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef45331-2acf-4186-aee0-89305db697d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:05.434364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45331-2acf-4186-aee0-89305db697d7 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:05.434795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45331-2acf-4186-aee0-89305db697d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:05.435227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45331-2acf-4186-aee0-89305db697d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:05.436008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef45331-2acf-4186-aee0-89305db697d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:05.436321 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef45331-2acf-4186-aee0-89305db697d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:05.437715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef45331-2acf-4186-aee0-89305db697d7 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:05.451121 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 7/15] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:05.456832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef45331-2acf-4186-aee0-89305db697d7 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:05.540838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 9/16] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:05.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80d23e-4c3f-453f-a196-635c0c384f85 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:05.551249 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:05.670437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80d23e-4c3f-453f-a196-635c0c384f85 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:05.677598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef45331-2acf-4186-aee0-89305db697d7 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:05.707048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad467288-74d5-4d73-a85a-77cc182235ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:05.707948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad467288-74d5-4d73-a85a-77cc182235ca None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:05.708244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad467288-74d5-4d73-a85a-77cc182235ca None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:05.709328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad467288-74d5-4d73-a85a-77cc182235ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:05.713871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936e1b-5485-4261-a4f0-5f5ed58a9d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:05.714519 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936e1b-5485-4261-a4f0-5f5ed58a9d28 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:05.714801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936e1b-5485-4261-a4f0-5f5ed58a9d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:05.715075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936e1b-5485-4261-a4f0-5f5ed58a9d28 None admin] PATH_INFO: `/v3/users/21d88c6eac2e460ca7e17f398e2ce9da` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:05.716277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82936e1b-5485-4261-a4f0-5f5ed58a9d28 None admin] RBAC: Authorizing `identity:get_user(user_id=21d88c6eac2e460ca7e17f398e2ce9da)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:05.717726 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82936e1b-5485-4261-a4f0-5f5ed58a9d28 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:05.719309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 8/17] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:05 2022] GET /identity/v3/users/21d88c6eac2e460ca7e17f398e2ce9da => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:05.725132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936e1b-5485-4261-a4f0-5f5ed58a9d28 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:05.727869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad467288-74d5-4d73-a85a-77cc182235ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:05.729339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad467288-74d5-4d73-a85a-77cc182235ca None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:05.739379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-ad467288-74d5-4d73-a85a-77cc182235ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:05.747855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:05.748717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:05.749640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:05.749640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:05.749640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:05.749640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:05.749640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:24:05.754761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad467288-74d5-4d73-a85a-77cc182235ca None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:05.813069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:05.827892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936e1b-5485-4261-a4f0-5f5ed58a9d28 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:05.858890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad467288-74d5-4d73-a85a-77cc182235ca None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:05.864494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62188fc7-99f6-4149-887a-f92d62dc9085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:05.865704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188fc7-99f6-4149-887a-f92d62dc9085 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:05.865988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188fc7-99f6-4149-887a-f92d62dc9085 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:05.866276 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62188fc7-99f6-4149-887a-f92d62dc9085 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:05.867467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62188fc7-99f6-4149-887a-f92d62dc9085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:05.868956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62188fc7-99f6-4149-887a-f92d62dc9085 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:05.870714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:05.876206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62188fc7-99f6-4149-887a-f92d62dc9085 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:05.893185 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ce1bc-e1fc-4189-b631-591557962e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:05.893807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ce1bc-e1fc-4189-b631-591557962e7e None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:05.894095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ce1bc-e1fc-4189-b631-591557962e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:05.894370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ce1bc-e1fc-4189-b631-591557962e7e None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:05.895064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ce1bc-e1fc-4189-b631-591557962e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:05.895371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ce1bc-e1fc-4189-b631-591557962e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:05.897239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ce1bc-e1fc-4189-b631-591557962e7e None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:05.914949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:05.960878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:05.981450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62188fc7-99f6-4149-887a-f92d62dc9085 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:06.018683 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a06087-3112-48ec-aca9-e85c0820db01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:06.019332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a06087-3112-48ec-aca9-e85c0820db01 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:06.019600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a06087-3112-48ec-aca9-e85c0820db01 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:06.019911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a06087-3112-48ec-aca9-e85c0820db01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:06.020729 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a06087-3112-48ec-aca9-e85c0820db01 None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.domain.id=default, user.id=21d88c6eac2e460ca7e17f398e2ce9da) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:06.021272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a06087-3112-48ec-aca9-e85c0820db01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:06.022595 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a06087-3112-48ec-aca9-e85c0820db01 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:06.030169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1322 bytes} [Mon Jul 25 21:24:05 2022] GET /identity/v3/role_assignments?user.id=21d88c6eac2e460ca7e17f398e2ce9da&scope.domain.id=default&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:08.379776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673ed9-b551-4029-b00c-b5a0caebbdda None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:08.379776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673ed9-b551-4029-b00c-b5a0caebbdda None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:08.379776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673ed9-b551-4029-b00c-b5a0caebbdda None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:08.381451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:08.384275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032bbb6-8cd8-4bed-b90f-130697dc480b None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:08.385003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032bbb6-8cd8-4bed-b90f-130697dc480b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:08.385495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032bbb6-8cd8-4bed-b90f-130697dc480b None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:08.387034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 11/23] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:08.388458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338da62-0cef-4d51-a3ab-680544107d02 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:08.388962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338da62-0cef-4d51-a3ab-680544107d02 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:08.389469 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338da62-0cef-4d51-a3ab-680544107d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:08.402483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf3d9-569d-46e0-a0c0-a4032f662c5c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:08.403057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf3d9-569d-46e0-a0c0-a4032f662c5c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:08.403560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddf3d9-569d-46e0-a0c0-a4032f662c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:08.431887 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-faddf3d9-569d-46e0-a0c0-a4032f662c5c None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:08.433420 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-faddf3d9-569d-46e0-a0c0-a4032f662c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:08.436408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-6338da62-0cef-4d51-a3ab-680544107d02 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:08.437803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-6338da62-0cef-4d51-a3ab-680544107d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:08.564598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 12/24] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:24:08.566508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4b702-a6ee-47d4-8651-e32b61a9738a None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:08.567022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4b702-a6ee-47d4-8651-e32b61a9738a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:08.567501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4b702-a6ee-47d4-8651-e32b61a9738a None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:08.570408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 13/25] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:08.578905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceedc9-eda3-46d1-9fc1-40bedd803ca3 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:08.579474 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceedc9-eda3-46d1-9fc1-40bedd803ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:08.579981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceedc9-eda3-46d1-9fc1-40bedd803ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:08.594339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 13/26] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:08.601317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-5cceedc9-eda3-46d1-9fc1-40bedd803ca3 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:08.602867 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5cceedc9-eda3-46d1-9fc1-40bedd803ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:08.608921 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338da62-0cef-4d51-a3ab-680544107d02 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:08.707660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:08.713129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 14/27] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:08.714392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceedc9-eda3-46d1-9fc1-40bedd803ca3 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:08.718337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:08.847923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338da62-0cef-4d51-a3ab-680544107d02 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:08.900285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceedc9-eda3-46d1-9fc1-40bedd803ca3 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:08.921629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13895054-b4bb-4304-b0fd-0b5bf0a4de6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:08.922269 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13895054-b4bb-4304-b0fd-0b5bf0a4de6f None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:08.922552 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13895054-b4bb-4304-b0fd-0b5bf0a4de6f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:08.922826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13895054-b4bb-4304-b0fd-0b5bf0a4de6f None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:08.923549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13895054-b4bb-4304-b0fd-0b5bf0a4de6f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:08.924970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13895054-b4bb-4304-b0fd-0b5bf0a4de6f None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:08.953578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3b076-e276-42e9-98db-e81276c7130d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:08.953578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3b076-e276-42e9-98db-e81276c7130d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:08.953578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3b076-e276-42e9-98db-e81276c7130d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:08.953578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3b076-e276-42e9-98db-e81276c7130d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:08.964363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3b076-e276-42e9-98db-e81276c7130d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-6dc3b076-e276-42e9-98db-e81276c7130d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:08.970106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:08.971117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:08.972159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:08.972159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:08.972159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:08.972159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:08.972159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:08.972159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:08.972159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:08.972159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:08.972159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:08.972159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:08.972159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:08.972159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:08.974191 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 15/28] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:24:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:08.975535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3b076-e276-42e9-98db-e81276c7130d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:09.045047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:09.091634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3b076-e276-42e9-98db-e81276c7130d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:09.137328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d0be9-f05d-4f0a-9e6f-5659bec6e737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:09.138052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d0be9-f05d-4f0a-9e6f-5659bec6e737 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:09.138347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d0be9-f05d-4f0a-9e6f-5659bec6e737 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:09.138630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d0be9-f05d-4f0a-9e6f-5659bec6e737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:09.151234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d0be9-f05d-4f0a-9e6f-5659bec6e737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:09.153231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d0be9-f05d-4f0a-9e6f-5659bec6e737 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-113d0be9-f05d-4f0a-9e6f-5659bec6e737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:24:09.170348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:09.171223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:09.172036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:24:09.172036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:24:09.172036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:24:09.172036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:09.176644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 16/29] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:09.178077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d0be9-f05d-4f0a-9e6f-5659bec6e737 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:09.265056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 14/30] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 25 21:24:08 2022] POST /identity/v3/roles => generated 219 bytes in 657 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:24:09.267011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bde73b-1705-4447-bfad-c14d9c73cbc7 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:09.267532 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bde73b-1705-4447-bfad-c14d9c73cbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:09.268032 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bde73b-1705-4447-bfad-c14d9c73cbc7 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:09.269579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 15/31] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:09.270657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bde73b-1705-4447-bfad-c14d9c73cbc7 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:09.302704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d0be9-f05d-4f0a-9e6f-5659bec6e737 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:09.373397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:09.431023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843a32f-6f0c-48eb-8db2-1fcf3fa6db7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:09.432125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843a32f-6f0c-48eb-8db2-1fcf3fa6db7f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:09.432626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843a32f-6f0c-48eb-8db2-1fcf3fa6db7f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:09.433131 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843a32f-6f0c-48eb-8db2-1fcf3fa6db7f None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:09.434459 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843a32f-6f0c-48eb-8db2-1fcf3fa6db7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:09.435004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843a32f-6f0c-48eb-8db2-1fcf3fa6db7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:09.439362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843a32f-6f0c-48eb-8db2-1fcf3fa6db7f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:09.455188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 17/32] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:09.457359 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46061c-fb5c-455e-a914-cc591014fc51 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:09.457865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46061c-fb5c-455e-a914-cc591014fc51 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:09.458397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46061c-fb5c-455e-a914-cc591014fc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:09.493612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ef46061c-fb5c-455e-a914-cc591014fc51 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:09.494844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ef46061c-fb5c-455e-a914-cc591014fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:09.503918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bde73b-1705-4447-bfad-c14d9c73cbc7 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:09.514801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:09.551416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617a842-128a-485c-be34-e83e65d66819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:09.552045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617a842-128a-485c-be34-e83e65d66819 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:09.552818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617a842-128a-485c-be34-e83e65d66819 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:09.553215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617a842-128a-485c-be34-e83e65d66819 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:09.553933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617a842-128a-485c-be34-e83e65d66819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:09.554238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617a842-128a-485c-be34-e83e65d66819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:09.556508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617a842-128a-485c-be34-e83e65d66819 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:09.571862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 16/33] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:09.573672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617a842-128a-485c-be34-e83e65d66819 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:09.583145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 18/34] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:09.584800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46061c-fb5c-455e-a914-cc591014fc51 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:09.707696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617a842-128a-485c-be34-e83e65d66819 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:09.711702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46061c-fb5c-455e-a914-cc591014fc51 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:09.721392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:09.749987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e38e52-7e94-4fb9-8d02-79377be01fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:09.750327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ff579-e877-4903-9fc7-3eaa890cd5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:09.750665 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e38e52-7e94-4fb9-8d02-79377be01fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:09.750937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ff579-e877-4903-9fc7-3eaa890cd5bd None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:09.751029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e38e52-7e94-4fb9-8d02-79377be01fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:09.751265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e38e52-7e94-4fb9-8d02-79377be01fb3 None admin] PATH_INFO: `/v3/users/21d88c6eac2e460ca7e17f398e2ce9da` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:09.751372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ff579-e877-4903-9fc7-3eaa890cd5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:09.751550 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ff579-e877-4903-9fc7-3eaa890cd5bd None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:09.752282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ff579-e877-4903-9fc7-3eaa890cd5bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:09.753187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e38e52-7e94-4fb9-8d02-79377be01fb3 None admin] RBAC: Authorizing `identity:get_user(user_id=21d88c6eac2e460ca7e17f398e2ce9da)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:09.753750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ff579-e877-4903-9fc7-3eaa890cd5bd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:09.754635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e38e52-7e94-4fb9-8d02-79377be01fb3 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:09.756496 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 17/35] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:09 2022] GET /identity/v3/users/21d88c6eac2e460ca7e17f398e2ce9da => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:09.759560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e38e52-7e94-4fb9-8d02-79377be01fb3 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:09.794355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:09.861020 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e38e52-7e94-4fb9-8d02-79377be01fb3 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:09.894227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b3b40-77f3-492e-a0a7-775283f14502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:09.894847 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3b40-77f3-492e-a0a7-775283f14502 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:09.895164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3b40-77f3-492e-a0a7-775283f14502 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:09.895453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3b40-77f3-492e-a0a7-775283f14502 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:09.897500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b3b40-77f3-492e-a0a7-775283f14502 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:09.899186 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b3b40-77f3-492e-a0a7-775283f14502 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:09.977068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 19/36] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 21:24:09 2022] POST /identity/v3/projects => generated 301 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:24:09.978616 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30163710-9eb2-45b4-8d1a-d8a20425bfe1 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:09.978917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30163710-9eb2-45b4-8d1a-d8a20425bfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:09.979199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30163710-9eb2-45b4-8d1a-d8a20425bfe1 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:09.980476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 20/37] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:09.981209 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30163710-9eb2-45b4-8d1a-d8a20425bfe1 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:09.992064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 18/38] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 25 21:24:09 2022] POST /identity/v3/roles => generated 225 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:24:09.992064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d1f92-f239-4b85-a208-9bddc28352e0 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:09.992064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d1f92-f239-4b85-a208-9bddc28352e0 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:09.992064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d1f92-f239-4b85-a208-9bddc28352e0 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:09.992064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 19/39] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:09.992064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd4078-4711-43db-b7a8-589a3af7877a None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:09.992064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd4078-4711-43db-b7a8-589a3af7877a None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:09.992668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd4078-4711-43db-b7a8-589a3af7877a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:10.024700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-7ddd4078-4711-43db-b7a8-589a3af7877a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:10.027170 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-7ddd4078-4711-43db-b7a8-589a3af7877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:10.127663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30163710-9eb2-45b4-8d1a-d8a20425bfe1 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:10.139946 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 20/40] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:10.141683 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e7bc9-60de-47c0-a888-adb44911018c None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:10.142086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e7bc9-60de-47c0-a888-adb44911018c None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:10.142470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e7bc9-60de-47c0-a888-adb44911018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:10.167106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-138e7bc9-60de-47c0-a888-adb44911018c None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:10.167498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-138e7bc9-60de-47c0-a888-adb44911018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:10.178526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147974f-494a-46eb-8a81-bcb20ee4838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:10.179558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147974f-494a-46eb-8a81-bcb20ee4838c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:10.179892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147974f-494a-46eb-8a81-bcb20ee4838c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:10.180175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147974f-494a-46eb-8a81-bcb20ee4838c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:10.181819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147974f-494a-46eb-8a81-bcb20ee4838c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:10.183397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147974f-494a-46eb-8a81-bcb20ee4838c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:10.185893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 21/41] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:10.187496 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147974f-494a-46eb-8a81-bcb20ee4838c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:10.193241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:10.225793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:10.256356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 21/42] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:10.257206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e7bc9-60de-47c0-a888-adb44911018c None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:10.308832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147974f-494a-46eb-8a81-bcb20ee4838c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:10.343471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935928c-d583-43f6-9d2e-d04a6ec26d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:10.344208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935928c-d583-43f6-9d2e-d04a6ec26d11 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:10.344498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935928c-d583-43f6-9d2e-d04a6ec26d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:10.344783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935928c-d583-43f6-9d2e-d04a6ec26d11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:10.345952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935928c-d583-43f6-9d2e-d04a6ec26d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:10.347414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935928c-d583-43f6-9d2e-d04a6ec26d11 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:10.349895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 22/43] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:10.350367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935928c-d583-43f6-9d2e-d04a6ec26d11 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:10.358225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e7bc9-60de-47c0-a888-adb44911018c None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:10.392445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeae82b-ea73-4775-b71e-551c0571549f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:10.393048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae82b-ea73-4775-b71e-551c0571549f None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:10.393334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae82b-ea73-4775-b71e-551c0571549f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:10.393613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae82b-ea73-4775-b71e-551c0571549f None admin] PATH_INFO: `/v3/domains/default/users/21d88c6eac2e460ca7e17f398e2ce9da/roles/11da9ce3f79148679dbde9eb2c568e55` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:10.395600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeae82b-ea73-4775-b71e-551c0571549f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=21d88c6eac2e460ca7e17f398e2ce9da, role_id=11da9ce3f79148679dbde9eb2c568e55)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:10.397147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeae82b-ea73-4775-b71e-551c0571549f None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:10.443393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:10.449065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935928c-d583-43f6-9d2e-d04a6ec26d11 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:10.481506 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82974d68-b2a4-4ff7-be9b-8aabc51a2378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:10.482122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82974d68-b2a4-4ff7-be9b-8aabc51a2378 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:10.482407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82974d68-b2a4-4ff7-be9b-8aabc51a2378 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:10.482687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82974d68-b2a4-4ff7-be9b-8aabc51a2378 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:10.483406 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82974d68-b2a4-4ff7-be9b-8aabc51a2378 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:10.484958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82974d68-b2a4-4ff7-be9b-8aabc51a2378 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:10.496555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 22/44] 10.222.0.27 () {58 vars in 1361 bytes} [Mon Jul 25 21:24:10 2022] PUT /identity/v3/domains/default/users/21d88c6eac2e460ca7e17f398e2ce9da/roles/11da9ce3f79148679dbde9eb2c568e55 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:24:10.497356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeae82b-ea73-4775-b71e-551c0571549f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:10.516335 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:10.579585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 23/45] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 25 21:24:10 2022] POST /identity/v3/roles => generated 223 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:24:10.612125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeae82b-ea73-4775-b71e-551c0571549f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:10.659984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168340af-b557-4282-853e-d1bf10ca522b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:10.660570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168340af-b557-4282-853e-d1bf10ca522b None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:10.660859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168340af-b557-4282-853e-d1bf10ca522b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:10.661141 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168340af-b557-4282-853e-d1bf10ca522b None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:10.662731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168340af-b557-4282-853e-d1bf10ca522b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:10.664307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168340af-b557-4282-853e-d1bf10ca522b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:10.756188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 21:24:10 2022] POST /identity/v3/projects => generated 312 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:24:12.523113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2440d8-b368-4d57-90c9-e86107071272 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:12.523631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2440d8-b368-4d57-90c9-e86107071272 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:12.523807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2440d8-b368-4d57-90c9-e86107071272 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:12.525169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 24/47] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:12.530349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc89911-f7fd-43a5-911e-c89a12d1bbf8 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:12.530741 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc89911-f7fd-43a5-911e-c89a12d1bbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:12.530920 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc89911-f7fd-43a5-911e-c89a12d1bbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:12.550006 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-cbc89911-f7fd-43a5-911e-c89a12d1bbf8 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:12.551216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-cbc89911-f7fd-43a5-911e-c89a12d1bbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:12.611554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:12.619152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 24/48] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:12.642047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2440d8-b368-4d57-90c9-e86107071272 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:12.749301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2440d8-b368-4d57-90c9-e86107071272 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:12.772473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b2f7-2da7-4090-b575-23383c6e444e None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:12.772765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b2f7-2da7-4090-b575-23383c6e444e None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:12.773050 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b2f7-2da7-4090-b575-23383c6e444e None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:12.774477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 25/49] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:12.779129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604bd9-c0f0-4839-8673-c4de28b10094 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:12.779508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604bd9-c0f0-4839-8673-c4de28b10094 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:12.779886 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604bd9-c0f0-4839-8673-c4de28b10094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:12.783323 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88008ed-0b25-4125-8780-154d716ff517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:12.784001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88008ed-0b25-4125-8780-154d716ff517 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:12.784291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88008ed-0b25-4125-8780-154d716ff517 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:12.784574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88008ed-0b25-4125-8780-154d716ff517 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:12.795915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88008ed-0b25-4125-8780-154d716ff517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:12.798285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-df604bd9-c0f0-4839-8673-c4de28b10094 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:12.799495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-df604bd9-c0f0-4839-8673-c4de28b10094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-f88008ed-0b25-4125-8780-154d716ff517 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:12.801391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:12.802436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:12.803350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:12.803350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:12.803350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:12.803350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:12.803350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:12.803350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:12.803350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:12.803350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:12.803350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:12.803350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:12.803350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:12.803350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:12.803350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 25/50] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:24:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:12.809497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88008ed-0b25-4125-8780-154d716ff517 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:12.826922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:12.878640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 26/51] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:24:12.903959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604bd9-c0f0-4839-8673-c4de28b10094 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:12.917132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88008ed-0b25-4125-8780-154d716ff517 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:12.951090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fd5bb-4269-49f7-b3a9-91b9ac8dd953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:12.951716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fd5bb-4269-49f7-b3a9-91b9ac8dd953 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:12.952026 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fd5bb-4269-49f7-b3a9-91b9ac8dd953 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:12.952302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fd5bb-4269-49f7-b3a9-91b9ac8dd953 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:12.953018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fd5bb-4269-49f7-b3a9-91b9ac8dd953 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:12.953324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fd5bb-4269-49f7-b3a9-91b9ac8dd953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:12.954866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fd5bb-4269-49f7-b3a9-91b9ac8dd953 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:12.964063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 26/52] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:12.969557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fd5bb-4269-49f7-b3a9-91b9ac8dd953 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:13.008385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604bd9-c0f0-4839-8673-c4de28b10094 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:13.034421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:13.043146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589d4f9-7c17-4dd2-815b-f0b667f41cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:13.043819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589d4f9-7c17-4dd2-815b-f0b667f41cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:13.044114 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589d4f9-7c17-4dd2-815b-f0b667f41cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:13.044393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589d4f9-7c17-4dd2-815b-f0b667f41cb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:13.049745 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589d4f9-7c17-4dd2-815b-f0b667f41cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:13.049745 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589d4f9-7c17-4dd2-815b-f0b667f41cb4 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:13.049905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:13.049975 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 27/53] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:13.054942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589d4f9-7c17-4dd2-815b-f0b667f41cb4 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:13.069941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fd5bb-4269-49f7-b3a9-91b9ac8dd953 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:13.104799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ce6d9-0f5a-416d-b1e6-c7e47844db3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:13.105451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ce6d9-0f5a-416d-b1e6-c7e47844db3b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:13.105743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ce6d9-0f5a-416d-b1e6-c7e47844db3b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:13.106028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ce6d9-0f5a-416d-b1e6-c7e47844db3b None admin] PATH_INFO: `/v3/users/21d88c6eac2e460ca7e17f398e2ce9da` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:13.107443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ce6d9-0f5a-416d-b1e6-c7e47844db3b None admin] RBAC: Authorizing `identity:get_user(user_id=21d88c6eac2e460ca7e17f398e2ce9da)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:13.109627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ce6d9-0f5a-416d-b1e6-c7e47844db3b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:13.111257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 27/54] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:12 2022] GET /identity/v3/users/21d88c6eac2e460ca7e17f398e2ce9da => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:13.117370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ce6d9-0f5a-416d-b1e6-c7e47844db3b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:13.154045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589d4f9-7c17-4dd2-815b-f0b667f41cb4 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:13.188196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da88d4-b800-43ce-ae88-881656fd171b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:13.188818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da88d4-b800-43ce-ae88-881656fd171b None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:13.189104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da88d4-b800-43ce-ae88-881656fd171b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:13.189379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da88d4-b800-43ce-ae88-881656fd171b None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:13.190077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da88d4-b800-43ce-ae88-881656fd171b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:13.191515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da88d4-b800-43ce-ae88-881656fd171b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:13.215808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ce6d9-0f5a-416d-b1e6-c7e47844db3b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:13.250018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118c632-c4d6-4830-b672-2b00652ebb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:13.250659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118c632-c4d6-4830-b672-2b00652ebb9e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:13.250945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118c632-c4d6-4830-b672-2b00652ebb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:13.251227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118c632-c4d6-4830-b672-2b00652ebb9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:13.252392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118c632-c4d6-4830-b672-2b00652ebb9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:13.253862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118c632-c4d6-4830-b672-2b00652ebb9e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:13.256183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 28/55] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:13.263444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118c632-c4d6-4830-b672-2b00652ebb9e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:13.289230 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 28/56] 10.222.0.27 () {60 vars in 1140 bytes} [Mon Jul 25 21:24:13 2022] POST /identity/v3/projects => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:24:13.289420 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:13.382058 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118c632-c4d6-4830-b672-2b00652ebb9e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:13.419234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd2a85-0414-4c01-a9be-7acff71d34c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:13.419896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd2a85-0414-4c01-a9be-7acff71d34c9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:13.420179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd2a85-0414-4c01-a9be-7acff71d34c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:13.420455 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd2a85-0414-4c01-a9be-7acff71d34c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:13.421321 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd2a85-0414-4c01-a9be-7acff71d34c9 None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.domain.id=default, user.id=21d88c6eac2e460ca7e17f398e2ce9da) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:13.421633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd2a85-0414-4c01-a9be-7acff71d34c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:13.423093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd2a85-0414-4c01-a9be-7acff71d34c9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:13.430329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 29/57] 10.222.0.27 () {56 vars in 1322 bytes} [Mon Jul 25 21:24:13 2022] GET /identity/v3/role_assignments?user.id=21d88c6eac2e460ca7e17f398e2ce9da&scope.domain.id=default&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 530 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:15.321117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b007f-835d-47d3-bf7a-459a57b774b6 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:15.321686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b007f-835d-47d3-bf7a-459a57b774b6 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:15.321686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b007f-835d-47d3-bf7a-459a57b774b6 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:15.322999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 29/58] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:15.328142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65759a33-3eef-4b56-9f13-a01d94fbe940 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:15.328536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65759a33-3eef-4b56-9f13-a01d94fbe940 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:15.328706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65759a33-3eef-4b56-9f13-a01d94fbe940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:15.346468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-65759a33-3eef-4b56-9f13-a01d94fbe940 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:15.348089 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-65759a33-3eef-4b56-9f13-a01d94fbe940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:15.413328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 30/59] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:15.437559 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b007f-835d-47d3-bf7a-459a57b774b6 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:15.485010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:15.539338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b007f-835d-47d3-bf7a-459a57b774b6 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:15.573019 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d67a9-700f-444c-abfd-c0de7cd18de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:15.573587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d67a9-700f-444c-abfd-c0de7cd18de7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:15.573872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d67a9-700f-444c-abfd-c0de7cd18de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:15.574148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d67a9-700f-444c-abfd-c0de7cd18de7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:15.575311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d67a9-700f-444c-abfd-c0de7cd18de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:15.576783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d67a9-700f-444c-abfd-c0de7cd18de7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:15.578368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 30/60] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:15.584656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65759a33-3eef-4b56-9f13-a01d94fbe940 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:15.594692 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:15.683203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65759a33-3eef-4b56-9f13-a01d94fbe940 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:15.716819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea1745-22f1-4d32-b922-6c4a7e1a53c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:15.717442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea1745-22f1-4d32-b922-6c4a7e1a53c9 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:15.717731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea1745-22f1-4d32-b922-6c4a7e1a53c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:15.718009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea1745-22f1-4d32-b922-6c4a7e1a53c9 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:15.718709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea1745-22f1-4d32-b922-6c4a7e1a53c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:15.720204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea1745-22f1-4d32-b922-6c4a7e1a53c9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:15.840276 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 31/61] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:24:15 2022] POST /identity/v3/users => generated 275 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:24:19.131026 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57116060-afc2-41ff-a5f8-8ee514604b9d None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.132095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57116060-afc2-41ff-a5f8-8ee514604b9d None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.132588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57116060-afc2-41ff-a5f8-8ee514604b9d None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.134162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 31/62] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:19.139753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155c0b2-670a-4900-82cd-ee076c3bf28c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.140625 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155c0b2-670a-4900-82cd-ee076c3bf28c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.141201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155c0b2-670a-4900-82cd-ee076c3bf28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.168795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-9155c0b2-670a-4900-82cd-ee076c3bf28c None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:19.170349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9155c0b2-670a-4900-82cd-ee076c3bf28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:19.182491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45796785-8729-4db0-a1ba-c06686c83385 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.183085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45796785-8729-4db0-a1ba-c06686c83385 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.183602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45796785-8729-4db0-a1ba-c06686c83385 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.185270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 32/63] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:24:19.190580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffaed7-c798-481d-9e97-de83a7843cc6 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.191108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffaed7-c798-481d-9e97-de83a7843cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.191605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffaed7-c798-481d-9e97-de83a7843cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.215268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-54ffaed7-c798-481d-9e97-de83a7843cc6 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:19.216855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-54ffaed7-c798-481d-9e97-de83a7843cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:19.253622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:19.265365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 32/64] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:19.267122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259cdf8-af49-4b4e-b479-2ed4cb7f16d0 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.267561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259cdf8-af49-4b4e-b479-2ed4cb7f16d0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.268039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259cdf8-af49-4b4e-b479-2ed4cb7f16d0 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.269473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 33/65] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:19.282385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df2ec7-7e9b-4dae-a09f-a41bcbd9db49 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.282681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df2ec7-7e9b-4dae-a09f-a41bcbd9db49 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.282965 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df2ec7-7e9b-4dae-a09f-a41bcbd9db49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.305981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-65df2ec7-7e9b-4dae-a09f-a41bcbd9db49 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:19.308089 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-65df2ec7-7e9b-4dae-a09f-a41bcbd9db49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:19.315418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 33/66] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:24:19.319373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffaed7-c798-481d-9e97-de83a7843cc6 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:19.384434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:19.395574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 34/67] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:19.402879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7bad2-7b21-4c3d-9b0d-77d6bbde1455 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.402879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7bad2-7b21-4c3d-9b0d-77d6bbde1455 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.402879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7bad2-7b21-4c3d-9b0d-77d6bbde1455 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.402879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 35/68] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:19.402879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7bad2-7b21-4c3d-9b0d-77d6bbde1455 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:19.451723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffaed7-c798-481d-9e97-de83a7843cc6 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:19.488139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe981086-352d-412f-916a-b8058997ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:19.488886 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe981086-352d-412f-916a-b8058997ebbc None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.489175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe981086-352d-412f-916a-b8058997ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.489450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe981086-352d-412f-916a-b8058997ebbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.502791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe981086-352d-412f-916a-b8058997ebbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-fe981086-352d-412f-916a-b8058997ebbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:19.511232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:19.512503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:19.513267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:19.513267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:19.513267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:19.513267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:19.513267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:19.513267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:19.513267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:19.513267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:19.513267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:19.513267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:19.513267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:19.513267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:19.513267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:24:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:19.513878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9261d-d376-40ec-a498-2d204edae4ac None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.514338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9261d-d376-40ec-a498-2d204edae4ac None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.514338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9261d-d376-40ec-a498-2d204edae4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.525014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7bad2-7b21-4c3d-9b0d-77d6bbde1455 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:19.532862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-03f9261d-d376-40ec-a498-2d204edae4ac None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:19.534060 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-03f9261d-d376-40ec-a498-2d204edae4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:19.549647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:19.562557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c5248-193c-465f-b0d5-0adedb565555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:19.568313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c5248-193c-465f-b0d5-0adedb565555 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.568313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c5248-193c-465f-b0d5-0adedb565555 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.568313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c5248-193c-465f-b0d5-0adedb565555 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.575695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c5248-193c-465f-b0d5-0adedb565555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-5c4c5248-193c-465f-b0d5-0adedb565555 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:19.580853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:19.581691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:19.582451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:19.582451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:19.582451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:19.582451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:19.582451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:19.582451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:19.582451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:19.582451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:19.582451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:19.582451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:19.582451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:19.582451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:19.582451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 36/70] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:19.589344 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c5248-193c-465f-b0d5-0adedb565555 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:19.611625 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 35/71] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:19.612515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9261d-d376-40ec-a498-2d204edae4ac None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:19.651563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:19.693124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c5248-193c-465f-b0d5-0adedb565555 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:19.718399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9261d-d376-40ec-a498-2d204edae4ac None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:19.726868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689e0a7-6428-493b-861e-31c86f5d9f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:19.727520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689e0a7-6428-493b-861e-31c86f5d9f84 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.727833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689e0a7-6428-493b-861e-31c86f5d9f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.728392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689e0a7-6428-493b-861e-31c86f5d9f84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.738166 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689e0a7-6428-493b-861e-31c86f5d9f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2689e0a7-6428-493b-861e-31c86f5d9f84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:19.743697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:19.744575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:19.745332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:19.745332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:19.745332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:19.745332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:19.745332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:19.745332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:19.745332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:19.745332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:19.745332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:19.745332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:19.745332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:19.745332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:19.745332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 37/72] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:24:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:19.745958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689e0a7-6428-493b-861e-31c86f5d9f84 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:19.758864 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e408b-ec30-4843-aebb-0e8e3214c40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:19.759499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e408b-ec30-4843-aebb-0e8e3214c40a None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.759830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e408b-ec30-4843-aebb-0e8e3214c40a None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.760100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e408b-ec30-4843-aebb-0e8e3214c40a None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.760832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e408b-ec30-4843-aebb-0e8e3214c40a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:19.761144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e408b-ec30-4843-aebb-0e8e3214c40a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:19.762639 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e408b-ec30-4843-aebb-0e8e3214c40a None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:19.774545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:19.774545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31065ec9-5f5c-492a-8548-1e3f38cababf None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.774545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31065ec9-5f5c-492a-8548-1e3f38cababf None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.774545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31065ec9-5f5c-492a-8548-1e3f38cababf None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.774545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 37/74] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:19.774545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31065ec9-5f5c-492a-8548-1e3f38cababf None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:19.793446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:19.846949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689e0a7-6428-493b-861e-31c86f5d9f84 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:19.874242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:19.880910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31065ec9-5f5c-492a-8548-1e3f38cababf None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:19.882179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeea389-6be3-4938-922b-3f2c67506a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:19.882865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeea389-6be3-4938-922b-3f2c67506a1a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.883160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeea389-6be3-4938-922b-3f2c67506a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.883441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeea389-6be3-4938-922b-3f2c67506a1a None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.888330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeea389-6be3-4938-922b-3f2c67506a1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:19.888330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeea389-6be3-4938-922b-3f2c67506a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:19.888330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeea389-6be3-4938-922b-3f2c67506a1a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:19.894096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 38/75] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:19.895058 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeea389-6be3-4938-922b-3f2c67506a1a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:19.916815 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10738874-6b45-4830-a9c6-9529cf34cd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:19.917381 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738874-6b45-4830-a9c6-9529cf34cd89 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:19.917668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738874-6b45-4830-a9c6-9529cf34cd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:19.917949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10738874-6b45-4830-a9c6-9529cf34cd89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:19.928724 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10738874-6b45-4830-a9c6-9529cf34cd89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-10738874-6b45-4830-a9c6-9529cf34cd89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:19.933748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:19.934566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:19.935319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:19.935319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:19.935319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:19.935319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:19.935319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:19.935319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:19.935319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:19.935319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:19.935319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:19.935319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:19.935319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:19.935319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:19.935319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 38/76] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:19.936003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10738874-6b45-4830-a9c6-9529cf34cd89 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:19.997194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeea389-6be3-4938-922b-3f2c67506a1a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.004163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.031293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6515033-619a-4ef8-a3bf-e59128c3f5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.031948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6515033-619a-4ef8-a3bf-e59128c3f5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.032306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6515033-619a-4ef8-a3bf-e59128c3f5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.032586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6515033-619a-4ef8-a3bf-e59128c3f5d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.033310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6515033-619a-4ef8-a3bf-e59128c3f5d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:20.033614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6515033-619a-4ef8-a3bf-e59128c3f5d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.034986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6515033-619a-4ef8-a3bf-e59128c3f5d3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:20.040690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10738874-6b45-4830-a9c6-9529cf34cd89 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.044353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 39/77] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:24:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:20.045542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab07175-768a-4a5e-96c6-498d65c2159d None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.045834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab07175-768a-4a5e-96c6-498d65c2159d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.046115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab07175-768a-4a5e-96c6-498d65c2159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.063840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4ab07175-768a-4a5e-96c6-498d65c2159d None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:20.065063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4ab07175-768a-4a5e-96c6-498d65c2159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:20.077006 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8575a0-a3b5-486d-aa16-ee618bd61476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.077652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8575a0-a3b5-486d-aa16-ee618bd61476 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.077931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8575a0-a3b5-486d-aa16-ee618bd61476 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.078205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8575a0-a3b5-486d-aa16-ee618bd61476 None admin] PATH_INFO: `/v3/users/21d88c6eac2e460ca7e17f398e2ce9da` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.079384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8575a0-a3b5-486d-aa16-ee618bd61476 None admin] RBAC: Authorizing `identity:get_user(user_id=21d88c6eac2e460ca7e17f398e2ce9da)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.080858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8575a0-a3b5-486d-aa16-ee618bd61476 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:20.082454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 39/78] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:19 2022] GET /identity/v3/users/21d88c6eac2e460ca7e17f398e2ce9da => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:20.083209 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8575a0-a3b5-486d-aa16-ee618bd61476 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:20.113318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.132744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 40/79] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:20.133598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab07175-768a-4a5e-96c6-498d65c2159d None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:20.192262 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8575a0-a3b5-486d-aa16-ee618bd61476 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.226201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb4827-4f49-4db0-a5db-cf693a66909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.226843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb4827-4f49-4db0-a5db-cf693a66909b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.227125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb4827-4f49-4db0-a5db-cf693a66909b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.227407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb4827-4f49-4db0-a5db-cf693a66909b None admin] PATH_INFO: `/v3/users/0918a4fff7e7494b96471e61efa8a98f` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.229649 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.236770 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab07175-768a-4a5e-96c6-498d65c2159d None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.242171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb4827-4f49-4db0-a5db-cf693a66909b None admin] RBAC: Authorizing `identity:get_user(user_id=0918a4fff7e7494b96471e61efa8a98f)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.243769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb4827-4f49-4db0-a5db-cf693a66909b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:20.245385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 40/80] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:20 2022] GET /identity/v3/users/0918a4fff7e7494b96471e61efa8a98f => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:20.246165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb4827-4f49-4db0-a5db-cf693a66909b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:20.272172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee1e91-0052-4355-aa1d-7de3dfb6df3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.272799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee1e91-0052-4355-aa1d-7de3dfb6df3a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.273090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee1e91-0052-4355-aa1d-7de3dfb6df3a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.273368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee1e91-0052-4355-aa1d-7de3dfb6df3a None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.274094 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee1e91-0052-4355-aa1d-7de3dfb6df3a None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:20.274400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee1e91-0052-4355-aa1d-7de3dfb6df3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.275823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee1e91-0052-4355-aa1d-7de3dfb6df3a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:20.284100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 41/81] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:20.284915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee1e91-0052-4355-aa1d-7de3dfb6df3a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:20.327169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.345281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb4827-4f49-4db0-a5db-cf693a66909b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.378921 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5947b-98b3-40e3-8416-f7d3242534be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.379650 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5947b-98b3-40e3-8416-f7d3242534be None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.379964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5947b-98b3-40e3-8416-f7d3242534be None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.380845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5947b-98b3-40e3-8416-f7d3242534be None admin] PATH_INFO: `/v3/users/0918a4fff7e7494b96471e61efa8a98f` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.382353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5947b-98b3-40e3-8416-f7d3242534be None admin] RBAC: Authorizing `identity:get_user(user_id=0918a4fff7e7494b96471e61efa8a98f)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.383822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5947b-98b3-40e3-8416-f7d3242534be None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:20.384372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee1e91-0052-4355-aa1d-7de3dfb6df3a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.385422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 41/82] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:20 2022] GET /identity/v3/users/0918a4fff7e7494b96471e61efa8a98f => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:20.386179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5947b-98b3-40e3-8416-f7d3242534be None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:20.422934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f72b4b-f3ce-4de7-b874-8a68ff989cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.423556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f72b4b-f3ce-4de7-b874-8a68ff989cbb None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.423875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f72b4b-f3ce-4de7-b874-8a68ff989cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.424155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f72b4b-f3ce-4de7-b874-8a68ff989cbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.451567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.484438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5947b-98b3-40e3-8416-f7d3242534be None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.492209 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f72b4b-f3ce-4de7-b874-8a68ff989cbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.493699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f72b4b-f3ce-4de7-b874-8a68ff989cbb None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:20.518132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8decee-7488-453b-abc1-72644675e40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.518779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8decee-7488-453b-abc1-72644675e40e None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.519068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8decee-7488-453b-abc1-72644675e40e None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.519351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8decee-7488-453b-abc1-72644675e40e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.520551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8decee-7488-453b-abc1-72644675e40e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.522712 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8decee-7488-453b-abc1-72644675e40e None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:20.524339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 42/83] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:20.525105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8decee-7488-453b-abc1-72644675e40e None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:20.544018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.595012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 42/84] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:20.595884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f72b4b-f3ce-4de7-b874-8a68ff989cbb None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:20.627358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8decee-7488-453b-abc1-72644675e40e None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.656585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.660918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c8a55-aaf6-475a-bae1-dcb9b1ad37c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.662721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c8a55-aaf6-475a-bae1-dcb9b1ad37c0 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.663012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c8a55-aaf6-475a-bae1-dcb9b1ad37c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.663288 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c8a55-aaf6-475a-bae1-dcb9b1ad37c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.700553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f72b4b-f3ce-4de7-b874-8a68ff989cbb None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.731440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c8a55-aaf6-475a-bae1-dcb9b1ad37c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.732877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c8a55-aaf6-475a-bae1-dcb9b1ad37c0 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:20.736102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43909829-2560-497b-b7b7-84b3044d42a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.736760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43909829-2560-497b-b7b7-84b3044d42a9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.737046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43909829-2560-497b-b7b7-84b3044d42a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.737323 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43909829-2560-497b-b7b7-84b3044d42a9 None admin] PATH_INFO: `/v3/users/0918a4fff7e7494b96471e61efa8a98f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.738541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43909829-2560-497b-b7b7-84b3044d42a9 None admin] RBAC: Authorizing `identity:get_user(user_id=0918a4fff7e7494b96471e61efa8a98f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.740693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43909829-2560-497b-b7b7-84b3044d42a9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:20.742495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 43/85] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:20 2022] GET /identity/v3/users/0918a4fff7e7494b96471e61efa8a98f => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:20.743262 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43909829-2560-497b-b7b7-84b3044d42a9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:20.752200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.835674 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 43/86] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:20.836528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c8a55-aaf6-475a-bae1-dcb9b1ad37c0 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:20.842253 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43909829-2560-497b-b7b7-84b3044d42a9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.868484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.875664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da57076-f806-45e5-aab7-c2471fe2dd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.876308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da57076-f806-45e5-aab7-c2471fe2dd1d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.876595 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da57076-f806-45e5-aab7-c2471fe2dd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.876871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da57076-f806-45e5-aab7-c2471fe2dd1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.935916 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c8a55-aaf6-475a-bae1-dcb9b1ad37c0 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:20.947040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da57076-f806-45e5-aab7-c2471fe2dd1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.948595 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da57076-f806-45e5-aab7-c2471fe2dd1d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:20.954508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:20.970697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d3f36-4d0e-41cb-953e-85fc24b538e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:20.971326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d3f36-4d0e-41cb-953e-85fc24b538e6 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:20.971613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d3f36-4d0e-41cb-953e-85fc24b538e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:20.971933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d3f36-4d0e-41cb-953e-85fc24b538e6 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:20.972621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d3f36-4d0e-41cb-953e-85fc24b538e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:20.974110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d3f36-4d0e-41cb-953e-85fc24b538e6 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:21.046234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 44/87] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:21.047071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da57076-f806-45e5-aab7-c2471fe2dd1d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:21.072577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 44/88] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:24:20 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:24:21.073417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d3f36-4d0e-41cb-953e-85fc24b538e6 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:21.075039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:21.164923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da57076-f806-45e5-aab7-c2471fe2dd1d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:21.196114 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d3f36-4d0e-41cb-953e-85fc24b538e6 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:21.207877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a774417-d741-42dd-9f34-ef1236b8ba6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:21.208613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a774417-d741-42dd-9f34-ef1236b8ba6c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:21.209069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a774417-d741-42dd-9f34-ef1236b8ba6c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:21.209358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a774417-d741-42dd-9f34-ef1236b8ba6c None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:21.210668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a774417-d741-42dd-9f34-ef1236b8ba6c None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:21.212213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a774417-d741-42dd-9f34-ef1236b8ba6c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:21.218861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 45/89] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:21 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:21.218861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a774417-d741-42dd-9f34-ef1236b8ba6c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:21.240416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75234e-2364-411a-ba53-0172ac580b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:21.241106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75234e-2364-411a-ba53-0172ac580b14 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:21.241486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75234e-2364-411a-ba53-0172ac580b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:21.242307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75234e-2364-411a-ba53-0172ac580b14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:21.294162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:21.327386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75234e-2364-411a-ba53-0172ac580b14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:21.328869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75234e-2364-411a-ba53-0172ac580b14 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:21.341105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:21.347505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a774417-d741-42dd-9f34-ef1236b8ba6c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:21.388943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbc528-1e33-4ec2-a024-184cec4259f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:21.389752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbc528-1e33-4ec2-a024-184cec4259f3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:21.390046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbc528-1e33-4ec2-a024-184cec4259f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:21.390331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbc528-1e33-4ec2-a024-184cec4259f3 None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:21.391534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbc528-1e33-4ec2-a024-184cec4259f3 None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:21.393073 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbc528-1e33-4ec2-a024-184cec4259f3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:21.395075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 46/90] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:21 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:21.396790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbc528-1e33-4ec2-a024-184cec4259f3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:21.448546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 45/91] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:21.449640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75234e-2364-411a-ba53-0172ac580b14 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:21.512617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbc528-1e33-4ec2-a024-184cec4259f3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:21.539885 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:21.557704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8b26-0b4e-4b13-b426-d41c20e384d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:21.558427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8b26-0b4e-4b13-b426-d41c20e384d2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:21.558723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8b26-0b4e-4b13-b426-d41c20e384d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:21.559005 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8b26-0b4e-4b13-b426-d41c20e384d2 None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:21.560293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a8b26-0b4e-4b13-b426-d41c20e384d2 None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:21.561757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a8b26-0b4e-4b13-b426-d41c20e384d2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:21.563900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 47/92] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:21 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:21.564400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8b26-0b4e-4b13-b426-d41c20e384d2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:21.575927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75234e-2364-411a-ba53-0172ac580b14 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:21.600858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:21.624613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7e19c-ce02-4cbf-81e7-c961bff8a8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:21.626051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7e19c-ce02-4cbf-81e7-c961bff8a8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:21.626552 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7e19c-ce02-4cbf-81e7-c961bff8a8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:21.627297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7e19c-ce02-4cbf-81e7-c961bff8a8b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:21.628511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7e19c-ce02-4cbf-81e7-c961bff8a8b0 None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33, user.id=21d88c6eac2e460ca7e17f398e2ce9da) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:21.629354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7e19c-ce02-4cbf-81e7-c961bff8a8b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:21.632408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7e19c-ce02-4cbf-81e7-c961bff8a8b0 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:21.644289 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 46/93] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:21 2022] GET /identity/v3/role_assignments?user.id=21d88c6eac2e460ca7e17f398e2ce9da&scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:21.646819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7e19c-ce02-4cbf-81e7-c961bff8a8b0 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:21.689931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8b26-0b4e-4b13-b426-d41c20e384d2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:21.738748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9d6bf-c1bd-4ed3-a3a7-a27f0865f67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:21.742715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9d6bf-c1bd-4ed3-a3a7-a27f0865f67f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:21.743295 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9d6bf-c1bd-4ed3-a3a7-a27f0865f67f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:21.743800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9d6bf-c1bd-4ed3-a3a7-a27f0865f67f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:21.744843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9d6bf-c1bd-4ed3-a3a7-a27f0865f67f None admin] RBAC: Adding query filter params (role.id=59d226afaffe45f597d70faf647f2f22, scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33, user.id=0918a4fff7e7494b96471e61efa8a98f) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:21.745489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9d6bf-c1bd-4ed3-a3a7-a27f0865f67f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:21.749431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9d6bf-c1bd-4ed3-a3a7-a27f0865f67f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:21.764480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 48/94] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:21 2022] GET /identity/v3/role_assignments?user.id=0918a4fff7e7494b96471e61efa8a98f&scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33&role.id=59d226afaffe45f597d70faf647f2f22 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:21.768345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9d6bf-c1bd-4ed3-a3a7-a27f0865f67f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:21.901254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7e19c-ce02-4cbf-81e7-c961bff8a8b0 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:21.972660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974e2ae-33f8-4996-9a49-cc4fb48381eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:21.973327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974e2ae-33f8-4996-9a49-cc4fb48381eb None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:21.973610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974e2ae-33f8-4996-9a49-cc4fb48381eb None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:21.974393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974e2ae-33f8-4996-9a49-cc4fb48381eb None admin] PATH_INFO: `/v3/projects/52880559ca29410eab86548b79d88fc2` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:21.976815 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974e2ae-33f8-4996-9a49-cc4fb48381eb None admin] RBAC: Authorizing `identity:get_project(project_id=52880559ca29410eab86548b79d88fc2)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:21.978270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974e2ae-33f8-4996-9a49-cc4fb48381eb None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:21.979985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 47/95] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:21 2022] GET /identity/v3/projects/52880559ca29410eab86548b79d88fc2 => generated 312 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:21.994009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974e2ae-33f8-4996-9a49-cc4fb48381eb None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:22.000166 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:22.006590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9d6bf-c1bd-4ed3-a3a7-a27f0865f67f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:22.012129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:22.047847 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68442663-ebfb-460f-bd2f-1ea7b10dccd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:22.049671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442663-ebfb-460f-bd2f-1ea7b10dccd6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:22.049671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442663-ebfb-460f-bd2f-1ea7b10dccd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:22.049885 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68442663-ebfb-460f-bd2f-1ea7b10dccd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:22.051672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68442663-ebfb-460f-bd2f-1ea7b10dccd6 None admin] RBAC: Adding query filter params (role.id=8595eaa9629b4ec4a628d662402fd25d, scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33, user.id=0918a4fff7e7494b96471e61efa8a98f) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:22.051672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68442663-ebfb-460f-bd2f-1ea7b10dccd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:22.054009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68442663-ebfb-460f-bd2f-1ea7b10dccd6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:22.061731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 49/96] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:21 2022] GET /identity/v3/role_assignments?user.id=0918a4fff7e7494b96471e61efa8a98f&scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33&role.id=8595eaa9629b4ec4a628d662402fd25d => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:22.140985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974e2ae-33f8-4996-9a49-cc4fb48381eb None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:22.187771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09f6ed-49ca-42ee-860e-ca120f2800fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:22.188352 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09f6ed-49ca-42ee-860e-ca120f2800fd None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:22.188646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09f6ed-49ca-42ee-860e-ca120f2800fd None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:22.188930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09f6ed-49ca-42ee-860e-ca120f2800fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:22.189752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09f6ed-49ca-42ee-860e-ca120f2800fd None admin] RBAC: Adding query filter params (role.id=59d226afaffe45f597d70faf647f2f22, scope.project.id=52880559ca29410eab86548b79d88fc2, user.id=0918a4fff7e7494b96471e61efa8a98f) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:22.190071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09f6ed-49ca-42ee-860e-ca120f2800fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:22.191554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09f6ed-49ca-42ee-860e-ca120f2800fd None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:22.198105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 48/97] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:21 2022] GET /identity/v3/role_assignments?user.id=0918a4fff7e7494b96471e61efa8a98f&scope.project.id=52880559ca29410eab86548b79d88fc2&role.id=59d226afaffe45f597d70faf647f2f22 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:23.573796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9d3a5-18c7-4107-861c-055d233ba636 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:23.574819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9d3a5-18c7-4107-861c-055d233ba636 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:23.575291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9d3a5-18c7-4107-861c-055d233ba636 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:23.576897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 50/98] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:23.582505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb7eb0-242a-4f45-825d-a755ea36e390 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:23.583491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb7eb0-242a-4f45-825d-a755ea36e390 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:23.584564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb7eb0-242a-4f45-825d-a755ea36e390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:23.647657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-a5eb7eb0-242a-4f45-825d-a755ea36e390 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:23.649266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-a5eb7eb0-242a-4f45-825d-a755ea36e390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:23.758314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:23.763809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 49/99] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:23.797336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9d3a5-18c7-4107-861c-055d233ba636 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:23.910383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9d3a5-18c7-4107-861c-055d233ba636 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:23.955256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172516e-9b92-4697-b602-9ef9be24b207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:23.956270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172516e-9b92-4697-b602-9ef9be24b207 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:23.956748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172516e-9b92-4697-b602-9ef9be24b207 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:23.957255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172516e-9b92-4697-b602-9ef9be24b207 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:23.976995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f172516e-9b92-4697-b602-9ef9be24b207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-f172516e-9b92-4697-b602-9ef9be24b207 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:23.982569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:23.983480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:23.984265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:23.984265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:23.984265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:23.984265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:23.984265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:23.984265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:23.984265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:23.984265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:23.984265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:23.984265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:23.984265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:23.984265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:23.986786 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 51/100] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:23.993500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb7eb0-242a-4f45-825d-a755ea36e390 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:24.128196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb7eb0-242a-4f45-825d-a755ea36e390 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:24.172173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b81fa-87e9-42e4-aa91-920d7d0f4c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:24.172731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b81fa-87e9-42e4-aa91-920d7d0f4c13 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:24.173021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b81fa-87e9-42e4-aa91-920d7d0f4c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:24.173303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b81fa-87e9-42e4-aa91-920d7d0f4c13 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:24.174110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b81fa-87e9-42e4-aa91-920d7d0f4c13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:24.174427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b81fa-87e9-42e4-aa91-920d7d0f4c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:24.175848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b81fa-87e9-42e4-aa91-920d7d0f4c13 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:24.185293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 50/101] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:24.190835 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172516e-9b92-4697-b602-9ef9be24b207 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:24.230663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:24.342388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172516e-9b92-4697-b602-9ef9be24b207 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:24.374271 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f5678-fe7f-46f4-857d-591b5be77c4b None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:24.374743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f5678-fe7f-46f4-857d-591b5be77c4b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:24.375035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f5678-fe7f-46f4-857d-591b5be77c4b None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:24.376584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 51/102] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:24.385013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a04a1a-f1aa-413a-8092-e114f8d5ff7e None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:24.385332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a04a1a-f1aa-413a-8092-e114f8d5ff7e None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:24.385586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a04a1a-f1aa-413a-8092-e114f8d5ff7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:24.391432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4493711-88d9-4893-8082-d13348293750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:24.392467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4493711-88d9-4893-8082-d13348293750 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:24.393044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4493711-88d9-4893-8082-d13348293750 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:24.393518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4493711-88d9-4893-8082-d13348293750 None admin] PATH_INFO: `/v3/users/6feec32199b6443b8606351a9632efd5` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:24.408727 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4493711-88d9-4893-8082-d13348293750 None admin] RBAC: Authorizing `identity:get_user(user_id=6feec32199b6443b8606351a9632efd5)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:24.410556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4493711-88d9-4893-8082-d13348293750 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:24.413706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 52/103] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:24 2022] GET /identity/v3/users/6feec32199b6443b8606351a9632efd5 => generated 289 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:24.418229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-50a04a1a-f1aa-413a-8092-e114f8d5ff7e None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:24.419372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4493711-88d9-4893-8082-d13348293750 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:24.419478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-50a04a1a-f1aa-413a-8092-e114f8d5ff7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:24.507635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:24.511490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:24.530337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 52/104] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:24.540640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4493711-88d9-4893-8082-d13348293750 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:24.573387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202e352-1d5b-457b-9a3f-21a2acfbead1 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:24.573710 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202e352-1d5b-457b-9a3f-21a2acfbead1 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:24.573956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202e352-1d5b-457b-9a3f-21a2acfbead1 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:24.575610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 53/105] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:24:24.580505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc6f63-5b42-48ad-a797-81a2d8227733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:24.585041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202e352-1d5b-457b-9a3f-21a2acfbead1 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:24.586967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6f63-5b42-48ad-a797-81a2d8227733 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:24.587772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6f63-5b42-48ad-a797-81a2d8227733 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:24.588255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc6f63-5b42-48ad-a797-81a2d8227733 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:24.787857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc6f63-5b42-48ad-a797-81a2d8227733 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:24.789261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc6f63-5b42-48ad-a797-81a2d8227733 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:24.858655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202e352-1d5b-457b-9a3f-21a2acfbead1 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:24.924160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:24.935205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 53/106] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:24.936881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117e477-142f-4e71-bb50-b0ef67bff9ff None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:24.937241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117e477-142f-4e71-bb50-b0ef67bff9ff None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:24.937589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117e477-142f-4e71-bb50-b0ef67bff9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:24.947314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b8e6d-443d-431f-9765-c2656c89dd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:24.948009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b8e6d-443d-431f-9765-c2656c89dd0d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:24.948299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b8e6d-443d-431f-9765-c2656c89dd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:24.948579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b8e6d-443d-431f-9765-c2656c89dd0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:24.954130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b8e6d-443d-431f-9765-c2656c89dd0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:24.955591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b8e6d-443d-431f-9765-c2656c89dd0d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:24.959956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 54/107] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:24.960764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b8e6d-443d-431f-9765-c2656c89dd0d None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:24.967032 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-3117e477-142f-4e71-bb50-b0ef67bff9ff None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:24.974751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3117e477-142f-4e71-bb50-b0ef67bff9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:25.040789 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:25.054970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 54/108] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:25.055702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117e477-142f-4e71-bb50-b0ef67bff9ff None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:25.105858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b8e6d-443d-431f-9765-c2656c89dd0d None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:25.141376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20299d0f-54c9-4dd6-900b-ccf3ac0845bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:25.142035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20299d0f-54c9-4dd6-900b-ccf3ac0845bb None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.142324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20299d0f-54c9-4dd6-900b-ccf3ac0845bb None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.142605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20299d0f-54c9-4dd6-900b-ccf3ac0845bb None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.144045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20299d0f-54c9-4dd6-900b-ccf3ac0845bb None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:25.145512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20299d0f-54c9-4dd6-900b-ccf3ac0845bb None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:25.147404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 55/109] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:24 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:25.148658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ae6bb-a022-47f7-b292-d01c7073a463 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.148951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ae6bb-a022-47f7-b292-d01c7073a463 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.149231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ae6bb-a022-47f7-b292-d01c7073a463 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.150701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 56/110] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:25.151368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ae6bb-a022-47f7-b292-d01c7073a463 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:25.165044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117e477-142f-4e71-bb50-b0ef67bff9ff None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:25.175278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:25.202014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4642316-46b6-4c29-a11e-fdbedfdf92d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:25.202646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4642316-46b6-4c29-a11e-fdbedfdf92d0 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.202935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4642316-46b6-4c29-a11e-fdbedfdf92d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.203232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4642316-46b6-4c29-a11e-fdbedfdf92d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.203959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4642316-46b6-4c29-a11e-fdbedfdf92d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:25.205416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4642316-46b6-4c29-a11e-fdbedfdf92d0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:25.258517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ae6bb-a022-47f7-b292-d01c7073a463 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:25.287688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:25.296755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3d806-7cce-4340-9bf8-91c0f2a83825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:25.297348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3d806-7cce-4340-9bf8-91c0f2a83825 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.297627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3d806-7cce-4340-9bf8-91c0f2a83825 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.297901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3d806-7cce-4340-9bf8-91c0f2a83825 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.303298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 55/111] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 21:24:25 2022] POST /identity/v3/projects => generated 302 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:24:25.304433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4642316-46b6-4c29-a11e-fdbedfdf92d0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:25.310084 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3d806-7cce-4340-9bf8-91c0f2a83825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-45f3d806-7cce-4340-9bf8-91c0f2a83825 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:25.315596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:25.316577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:25.317340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:25.317340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:25.317340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:25.317340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:25.317340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:25.317340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:25.317340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:25.317340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:25.317340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:25.317340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:25.317340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:25.317340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:25.317340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 57/112] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:24:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:25.319047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa413b-1fbe-444a-ad98-bd95f1850c53 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.319460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa413b-1fbe-444a-ad98-bd95f1850c53 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.319621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa413b-1fbe-444a-ad98-bd95f1850c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.339656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-56fa413b-1fbe-444a-ad98-bd95f1850c53 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:25.340936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-56fa413b-1fbe-444a-ad98-bd95f1850c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:25.421418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 58/113] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:25.422747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee415aa-20bf-45a9-ad45-49518a969957 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.423041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee415aa-20bf-45a9-ad45-49518a969957 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.423319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee415aa-20bf-45a9-ad45-49518a969957 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.424953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 59/114] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:25.425852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b610a99-92a5-4cd7-b91e-54a51ae9ecc9 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.426186 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b610a99-92a5-4cd7-b91e-54a51ae9ecc9 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.426466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b610a99-92a5-4cd7-b91e-54a51ae9ecc9 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.428511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 60/115] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:25.434004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b610a99-92a5-4cd7-b91e-54a51ae9ecc9 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:25.445334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4642316-46b6-4c29-a11e-fdbedfdf92d0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:25.486304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000b00f-c5a7-46a1-9c49-a0ef5520b647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:25.487513 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b00f-c5a7-46a1-9c49-a0ef5520b647 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.487513 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b00f-c5a7-46a1-9c49-a0ef5520b647 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.487513 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b00f-c5a7-46a1-9c49-a0ef5520b647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.488516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000b00f-c5a7-46a1-9c49-a0ef5520b647 None admin] RBAC: Adding query filter params (role.id=0d4ee04c69134c1b81f17125e1b1c78d, scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33, user.id=6feec32199b6443b8606351a9632efd5) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:25.488733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000b00f-c5a7-46a1-9c49-a0ef5520b647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:25.490916 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000b00f-c5a7-46a1-9c49-a0ef5520b647 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:25.496578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 56/116] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:25 2022] GET /identity/v3/role_assignments?user.id=6feec32199b6443b8606351a9632efd5&scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33&role.id=0d4ee04c69134c1b81f17125e1b1c78d => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:25.498319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446f8ac-7dfc-45d6-a6c5-fe79bd38da27 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.498887 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446f8ac-7dfc-45d6-a6c5-fe79bd38da27 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.499358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446f8ac-7dfc-45d6-a6c5-fe79bd38da27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.519985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-b446f8ac-7dfc-45d6-a6c5-fe79bd38da27 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:25.521275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b446f8ac-7dfc-45d6-a6c5-fe79bd38da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:25.544195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:25.568334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b610a99-92a5-4cd7-b91e-54a51ae9ecc9 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:25.588379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:25.607689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 57/117] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:25.608340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fe70a-435e-4a9a-950c-a69394f8536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:25.609074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fe70a-435e-4a9a-950c-a69394f8536a None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.609203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391ae7e-cded-4c32-b8db-321825d432aa None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.609473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391ae7e-cded-4c32-b8db-321825d432aa None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.609584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fe70a-435e-4a9a-950c-a69394f8536a None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.609762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391ae7e-cded-4c32-b8db-321825d432aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.609964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fe70a-435e-4a9a-950c-a69394f8536a None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.610769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fe70a-435e-4a9a-950c-a69394f8536a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:25.611214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fe70a-435e-4a9a-950c-a69394f8536a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:25.612868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fe70a-435e-4a9a-950c-a69394f8536a None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:25.623621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 61/118] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:25.624775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fe70a-435e-4a9a-950c-a69394f8536a None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:25.629224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-1391ae7e-cded-4c32-b8db-321825d432aa None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:25.630669 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1391ae7e-cded-4c32-b8db-321825d432aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:25.721879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 58/119] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:25.722984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391ae7e-cded-4c32-b8db-321825d432aa None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:25.771096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fe70a-435e-4a9a-950c-a69394f8536a None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:25.807908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb80e5-d83a-427a-9962-6d03904b18c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:25.808627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb80e5-d83a-427a-9962-6d03904b18c3 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.808925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb80e5-d83a-427a-9962-6d03904b18c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.809207 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb80e5-d83a-427a-9962-6d03904b18c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.822429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb80e5-d83a-427a-9962-6d03904b18c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-21eb80e5-d83a-427a-9962-6d03904b18c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:25.827829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:25.828659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:25.829414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:25.829414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:25.829414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:25.829414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:25.829414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:25.829414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:25.829414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:25.829414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:25.829414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:25.829414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:25.829414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:25.829414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:25.829414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 62/120] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:24:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:25.830033 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb80e5-d83a-427a-9962-6d03904b18c3 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:25.830568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:25.851716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391ae7e-cded-4c32-b8db-321825d432aa None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:25.883571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:25.892551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a6813-1bc8-411c-885d-658a65924f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:25.893226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a6813-1bc8-411c-885d-658a65924f28 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.893584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a6813-1bc8-411c-885d-658a65924f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.893866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a6813-1bc8-411c-885d-658a65924f28 None admin] PATH_INFO: `/v3/users/21d88c6eac2e460ca7e17f398e2ce9da` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:25.895097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a6813-1bc8-411c-885d-658a65924f28 None admin] RBAC: Authorizing `identity:get_user(user_id=21d88c6eac2e460ca7e17f398e2ce9da)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:25.897110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a6813-1bc8-411c-885d-658a65924f28 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:25.899015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 59/121] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:25 2022] GET /identity/v3/users/21d88c6eac2e460ca7e17f398e2ce9da => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:25.899885 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a6813-1bc8-411c-885d-658a65924f28 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:25.953436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb80e5-d83a-427a-9962-6d03904b18c3 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:25.994598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc009319-c7f6-4004-a786-c936e6f5c4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:25.995537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009319-c7f6-4004-a786-c936e6f5c4ad None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:25.996004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009319-c7f6-4004-a786-c936e6f5c4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:25.996521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009319-c7f6-4004-a786-c936e6f5c4ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:26.008559 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a6813-1bc8-411c-885d-658a65924f28 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:26.013964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc009319-c7f6-4004-a786-c936e6f5c4ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-dc009319-c7f6-4004-a786-c936e6f5c4ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:26.021402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:26.022410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:26.023356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:26.023356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:26.023356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:26.023356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:26.023356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:26.023356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:26.023356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:26.023356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:26.023356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:26.023356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:26.023356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:26.023356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:26.026233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 63/122] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:26.027896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc009319-c7f6-4004-a786-c936e6f5c4ad None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:26.049480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a070b95-977a-435f-a5ac-f0e028a5e763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:26.050274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a070b95-977a-435f-a5ac-f0e028a5e763 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:26.050657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a070b95-977a-435f-a5ac-f0e028a5e763 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:26.051016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a070b95-977a-435f-a5ac-f0e028a5e763 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:26.062841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a070b95-977a-435f-a5ac-f0e028a5e763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-1a070b95-977a-435f-a5ac-f0e028a5e763 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:26.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:26.069891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:26.070846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:26.070846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:26.070846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:26.070846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:26.070846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:26.070846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:26.070846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:26.070846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:26.070846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:26.070846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:26.070846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:26.070846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:26.072871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 60/123] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:26.073702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a070b95-977a-435f-a5ac-f0e028a5e763 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:26.094482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:26.163440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:26.166272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc009319-c7f6-4004-a786-c936e6f5c4ad None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:26.193221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a070b95-977a-435f-a5ac-f0e028a5e763 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:26.202004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be0c6b-5891-4fcf-9d25-32a9f7ad69da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:26.202643 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be0c6b-5891-4fcf-9d25-32a9f7ad69da None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:26.202931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be0c6b-5891-4fcf-9d25-32a9f7ad69da None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:26.203210 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be0c6b-5891-4fcf-9d25-32a9f7ad69da None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:26.203980 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be0c6b-5891-4fcf-9d25-32a9f7ad69da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:26.204847 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be0c6b-5891-4fcf-9d25-32a9f7ad69da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:26.206223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be0c6b-5891-4fcf-9d25-32a9f7ad69da None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:26.219793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 64/124] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:24:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:26.219793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be0c6b-5891-4fcf-9d25-32a9f7ad69da None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:26.245483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff3264-d0f5-46d8-8f93-5f5e88e95057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:26.246521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff3264-d0f5-46d8-8f93-5f5e88e95057 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:26.246988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff3264-d0f5-46d8-8f93-5f5e88e95057 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:26.247408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff3264-d0f5-46d8-8f93-5f5e88e95057 None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:26.249016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff3264-d0f5-46d8-8f93-5f5e88e95057 None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:26.250747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff3264-d0f5-46d8-8f93-5f5e88e95057 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:26.252777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 61/125] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:26 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:26.258843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff3264-d0f5-46d8-8f93-5f5e88e95057 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:26.326851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be0c6b-5891-4fcf-9d25-32a9f7ad69da None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:26.350869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:26.361807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e08357-b640-4468-8064-1f617a453876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:26.362439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e08357-b640-4468-8064-1f617a453876 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:26.362734 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e08357-b640-4468-8064-1f617a453876 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:26.363121 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e08357-b640-4468-8064-1f617a453876 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:26.363731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e08357-b640-4468-8064-1f617a453876 None admin] RBAC: Adding query filter params (name=member) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:26.364116 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e08357-b640-4468-8064-1f617a453876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:26.366084 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e08357-b640-4468-8064-1f617a453876 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:26.373201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff3264-d0f5-46d8-8f93-5f5e88e95057 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:26.374525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 65/126] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:26.375339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e08357-b640-4468-8064-1f617a453876 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:26.401623 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:26.413248 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68e324-e95e-43dc-81c4-ab7eeb342634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:26.421281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68e324-e95e-43dc-81c4-ab7eeb342634 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:26.421281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68e324-e95e-43dc-81c4-ab7eeb342634 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:26.421281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68e324-e95e-43dc-81c4-ab7eeb342634 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:26.421281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68e324-e95e-43dc-81c4-ab7eeb342634 None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:26.421281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68e324-e95e-43dc-81c4-ab7eeb342634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:26.421281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68e324-e95e-43dc-81c4-ab7eeb342634 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:26.426011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 62/127] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:26.427587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68e324-e95e-43dc-81c4-ab7eeb342634 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:26.484277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e08357-b640-4468-8064-1f617a453876 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:26.519531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348fc48-d840-4fbc-8338-cb5c7c06aa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:26.520231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348fc48-d840-4fbc-8338-cb5c7c06aa66 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:26.520537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348fc48-d840-4fbc-8338-cb5c7c06aa66 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:26.520829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348fc48-d840-4fbc-8338-cb5c7c06aa66 None admin] PATH_INFO: `/v3/users/0918a4fff7e7494b96471e61efa8a98f` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:26.522186 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348fc48-d840-4fbc-8338-cb5c7c06aa66 None admin] RBAC: Authorizing `identity:get_user(user_id=0918a4fff7e7494b96471e61efa8a98f)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:26.523764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348fc48-d840-4fbc-8338-cb5c7c06aa66 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:26.529951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 66/128] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:26 2022] GET /identity/v3/users/0918a4fff7e7494b96471e61efa8a98f => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:26.529951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348fc48-d840-4fbc-8338-cb5c7c06aa66 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:26.541835 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68e324-e95e-43dc-81c4-ab7eeb342634 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:26.580875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef4e07-0434-4657-b60f-bef21c2d139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:26.581893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef4e07-0434-4657-b60f-bef21c2d139d None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:26.582330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef4e07-0434-4657-b60f-bef21c2d139d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:26.582749 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef4e07-0434-4657-b60f-bef21c2d139d None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33/users/21d88c6eac2e460ca7e17f398e2ce9da/roles/11da9ce3f79148679dbde9eb2c568e55` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:26.585340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef4e07-0434-4657-b60f-bef21c2d139d None admin] RBAC: Authorizing `identity:create_grant(project_id=ee4e6637d7984dabbbe2d7d731b48a33, user_id=21d88c6eac2e460ca7e17f398e2ce9da, role_id=11da9ce3f79148679dbde9eb2c568e55)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:26.586956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef4e07-0434-4657-b60f-bef21c2d139d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:26.628427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:26.637357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348fc48-d840-4fbc-8338-cb5c7c06aa66 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:26.667982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 63/129] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:24:26 2022] PUT /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33/users/21d88c6eac2e460ca7e17f398e2ce9da/roles/11da9ce3f79148679dbde9eb2c568e55 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:24:26.668906 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef4e07-0434-4657-b60f-bef21c2d139d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:26.671958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:26.676361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b438b-45b6-44d2-98b5-c520054bafdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:26.678109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b438b-45b6-44d2-98b5-c520054bafdd None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:26.678815 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b438b-45b6-44d2-98b5-c520054bafdd None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:26.679298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b438b-45b6-44d2-98b5-c520054bafdd None admin] PATH_INFO: `/v3/users/0918a4fff7e7494b96471e61efa8a98f` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:26.681416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b438b-45b6-44d2-98b5-c520054bafdd None admin] RBAC: Authorizing `identity:get_user(user_id=0918a4fff7e7494b96471e61efa8a98f)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:26.683491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b438b-45b6-44d2-98b5-c520054bafdd None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:26.686320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 67/130] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:26 2022] GET /identity/v3/users/0918a4fff7e7494b96471e61efa8a98f => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:26.687371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b438b-45b6-44d2-98b5-c520054bafdd None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:26.851580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef4e07-0434-4657-b60f-bef21c2d139d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:26.889899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba76394-66ad-49b1-82f4-badc483b6205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:26.890821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76394-66ad-49b1-82f4-badc483b6205 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:26.891252 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76394-66ad-49b1-82f4-badc483b6205 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:26.891673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76394-66ad-49b1-82f4-badc483b6205 None admin] PATH_INFO: `/v3/users/0918a4fff7e7494b96471e61efa8a98f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:26.893114 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba76394-66ad-49b1-82f4-badc483b6205 None admin] RBAC: Authorizing `identity:get_user(user_id=0918a4fff7e7494b96471e61efa8a98f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:26.895001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba76394-66ad-49b1-82f4-badc483b6205 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:26.896858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 64/131] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:26 2022] GET /identity/v3/users/0918a4fff7e7494b96471e61efa8a98f => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:26.897791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba76394-66ad-49b1-82f4-badc483b6205 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:26.897912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b438b-45b6-44d2-98b5-c520054bafdd None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:26.935992 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a254d22-582a-40a0-a20c-deeea2e7188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:26.936651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a254d22-582a-40a0-a20c-deeea2e7188e None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:26.937356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a254d22-582a-40a0-a20c-deeea2e7188e None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:26.937648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a254d22-582a-40a0-a20c-deeea2e7188e None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:26.939046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a254d22-582a-40a0-a20c-deeea2e7188e None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:26.943294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a254d22-582a-40a0-a20c-deeea2e7188e None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:26.943294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 68/132] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:26 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:26.943633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a254d22-582a-40a0-a20c-deeea2e7188e None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:26.981149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:26.993001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:27.033409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba76394-66ad-49b1-82f4-badc483b6205 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:27.071767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ad3dc-c253-4b49-bc12-e8714e769056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:27.071767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ad3dc-c253-4b49-bc12-e8714e769056 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:27.071767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ad3dc-c253-4b49-bc12-e8714e769056 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:27.071767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ad3dc-c253-4b49-bc12-e8714e769056 None admin] PATH_INFO: `/v3/projects/52880559ca29410eab86548b79d88fc2` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:27.073187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ad3dc-c253-4b49-bc12-e8714e769056 None admin] RBAC: Authorizing `identity:get_project(project_id=52880559ca29410eab86548b79d88fc2)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:27.074762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ad3dc-c253-4b49-bc12-e8714e769056 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:27.075552 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a254d22-582a-40a0-a20c-deeea2e7188e None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:27.076906 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 65/133] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:26 2022] GET /identity/v3/projects/52880559ca29410eab86548b79d88fc2 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:27.080540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ad3dc-c253-4b49-bc12-e8714e769056 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:27.149216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd386d-5e13-4202-9be7-9f1af029305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:27.149795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd386d-5e13-4202-9be7-9f1af029305f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:27.150083 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd386d-5e13-4202-9be7-9f1af029305f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:27.150359 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd386d-5e13-4202-9be7-9f1af029305f None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:27.152340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd386d-5e13-4202-9be7-9f1af029305f None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:27.153795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd386d-5e13-4202-9be7-9f1af029305f None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:27.156778 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 69/134] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:26 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:27.157535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd386d-5e13-4202-9be7-9f1af029305f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:27.265542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ad3dc-c253-4b49-bc12-e8714e769056 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:27.321197 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:27.326937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd386d-5e13-4202-9be7-9f1af029305f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:27.345833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd6b22-07c3-4dd9-bffd-85ee272c98b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:27.346528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6b22-07c3-4dd9-bffd-85ee272c98b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:27.346815 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6b22-07c3-4dd9-bffd-85ee272c98b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:27.347096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6b22-07c3-4dd9-bffd-85ee272c98b0 None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33/users/0918a4fff7e7494b96471e61efa8a98f/roles/8595eaa9629b4ec4a628d662402fd25d` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:27.353769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6b22-07c3-4dd9-bffd-85ee272c98b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee4e6637d7984dabbbe2d7d731b48a33, user_id=0918a4fff7e7494b96471e61efa8a98f, role_id=8595eaa9629b4ec4a628d662402fd25d)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:27.355262 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6b22-07c3-4dd9-bffd-85ee272c98b0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:27.364225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edefa6e-5dd6-430b-b565-028e46fa9a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:27.365282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edefa6e-5dd6-430b-b565-028e46fa9a4e None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:27.366098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edefa6e-5dd6-430b-b565-028e46fa9a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:27.370724 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edefa6e-5dd6-430b-b565-028e46fa9a4e None admin] PATH_INFO: `/v3/projects/52880559ca29410eab86548b79d88fc2/users/0918a4fff7e7494b96471e61efa8a98f/roles/59d226afaffe45f597d70faf647f2f22` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:27.370724 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edefa6e-5dd6-430b-b565-028e46fa9a4e None admin] RBAC: Authorizing `identity:create_grant(project_id=52880559ca29410eab86548b79d88fc2, user_id=0918a4fff7e7494b96471e61efa8a98f, role_id=59d226afaffe45f597d70faf647f2f22)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:27.370928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edefa6e-5dd6-430b-b565-028e46fa9a4e None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:27.448359 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:27.454388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 66/135] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:24:27 2022] PUT /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33/users/0918a4fff7e7494b96471e61efa8a98f/roles/8595eaa9629b4ec4a628d662402fd25d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:24:27.456659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd6b22-07c3-4dd9-bffd-85ee272c98b0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:27.488513 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 70/136] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:24:27 2022] PUT /identity/v3/projects/52880559ca29410eab86548b79d88fc2/users/0918a4fff7e7494b96471e61efa8a98f/roles/59d226afaffe45f597d70faf647f2f22 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:24:27.574241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd6b22-07c3-4dd9-bffd-85ee272c98b0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:27.598880 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912fb65-38df-4118-8c88-3584d753b3cb None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:27.604460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912fb65-38df-4118-8c88-3584d753b3cb None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:27.604460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912fb65-38df-4118-8c88-3584d753b3cb None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:27.604460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 71/137] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:24:27.612826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8ff77-d83b-4ef1-b795-06f016be35aa None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:27.613142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8ff77-d83b-4ef1-b795-06f016be35aa None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:27.613392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8ff77-d83b-4ef1-b795-06f016be35aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:27.617591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5d5b7-d85a-4418-8930-64ad85201bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:27.618654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5d5b7-d85a-4418-8930-64ad85201bd3 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:27.619172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5d5b7-d85a-4418-8930-64ad85201bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:27.619675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5d5b7-d85a-4418-8930-64ad85201bd3 None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33/users/0918a4fff7e7494b96471e61efa8a98f/roles/59d226afaffe45f597d70faf647f2f22` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:27.622154 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5d5b7-d85a-4418-8930-64ad85201bd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee4e6637d7984dabbbe2d7d731b48a33, user_id=0918a4fff7e7494b96471e61efa8a98f, role_id=59d226afaffe45f597d70faf647f2f22)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:27.623933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5d5b7-d85a-4418-8930-64ad85201bd3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:27.652693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-afd8ff77-d83b-4ef1-b795-06f016be35aa None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:27.653943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-afd8ff77-d83b-4ef1-b795-06f016be35aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:27.718370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 67/138] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:24:27 2022] PUT /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33/users/0918a4fff7e7494b96471e61efa8a98f/roles/59d226afaffe45f597d70faf647f2f22 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:24:27.770272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 72/139] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:24:27.795806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5d5b7-d85a-4418-8930-64ad85201bd3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:27.881253 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112529d1-8551-4c85-a658-126a183887f2 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:27.881599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112529d1-8551-4c85-a658-126a183887f2 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:27.881827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112529d1-8551-4c85-a658-126a183887f2 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:27.883200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 73/140] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:27.888668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab28c70-e3ee-4374-a512-a65680f6e7e4 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:27.888951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab28c70-e3ee-4374-a512-a65680f6e7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:27.889246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab28c70-e3ee-4374-a512-a65680f6e7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:27.892085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:27.924604 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-5ab28c70-e3ee-4374-a512-a65680f6e7e4 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:27.925814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-5ab28c70-e3ee-4374-a512-a65680f6e7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:27.936658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5d5b7-d85a-4418-8930-64ad85201bd3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:27.981844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4596ad-eab7-48f1-a5c9-6406a004e69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:27.982592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4596ad-eab7-48f1-a5c9-6406a004e69a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:27.983078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4596ad-eab7-48f1-a5c9-6406a004e69a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:27.983464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4596ad-eab7-48f1-a5c9-6406a004e69a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:27.986418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4596ad-eab7-48f1-a5c9-6406a004e69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:27.988136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4596ad-eab7-48f1-a5c9-6406a004e69a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:27.990641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 68/141] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:27.996538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4596ad-eab7-48f1-a5c9-6406a004e69a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:28.013982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 74/142] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:28.054873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab28c70-e3ee-4374-a512-a65680f6e7e4 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:28.087444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:28.109342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4596ad-eab7-48f1-a5c9-6406a004e69a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:28.136566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:28.150245 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d5a87-2b62-41f7-9025-e0b89cf2c834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:28.151037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d5a87-2b62-41f7-9025-e0b89cf2c834 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:28.151395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d5a87-2b62-41f7-9025-e0b89cf2c834 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:28.151773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d5a87-2b62-41f7-9025-e0b89cf2c834 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:28.152552 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d5a87-2b62-41f7-9025-e0b89cf2c834 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:28.154081 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d5a87-2b62-41f7-9025-e0b89cf2c834 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:28.223246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab28c70-e3ee-4374-a512-a65680f6e7e4 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:28.262537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 69/143] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:24:27 2022] POST /identity/v3/users => generated 283 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:24:28.275199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff42c0-a5c6-4c78-ba00-918e8c283185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:28.275907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff42c0-a5c6-4c78-ba00-918e8c283185 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:28.276195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff42c0-a5c6-4c78-ba00-918e8c283185 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:28.276475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff42c0-a5c6-4c78-ba00-918e8c283185 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:28.292135 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff42c0-a5c6-4c78-ba00-918e8c283185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-61ff42c0-a5c6-4c78-ba00-918e8c283185 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:28.297679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:28.298704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:28.299637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:28.299637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:28.299637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:28.299637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:28.299637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:28.299637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:28.299637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:28.299637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:28.299637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:28.299637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:28.299637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:28.299637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:28.299637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 75/144] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:24:28.306821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d5a87-2b62-41f7-9025-e0b89cf2c834 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:28.434301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d5a87-2b62-41f7-9025-e0b89cf2c834 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:28.470482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96398ac1-2bc1-4e2a-a239-06426deeb596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:28.471226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96398ac1-2bc1-4e2a-a239-06426deeb596 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:28.471584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96398ac1-2bc1-4e2a-a239-06426deeb596 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:28.471961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96398ac1-2bc1-4e2a-a239-06426deeb596 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:28.472843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96398ac1-2bc1-4e2a-a239-06426deeb596 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:28.473222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96398ac1-2bc1-4e2a-a239-06426deeb596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:28.474787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96398ac1-2bc1-4e2a-a239-06426deeb596 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:28.484285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 70/145] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:28.490419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff42c0-a5c6-4c78-ba00-918e8c283185 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:28.590064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:28.620927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff42c0-a5c6-4c78-ba00-918e8c283185 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:28.667899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8cd1e-f979-486b-a8b3-79e95deed08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:28.668646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8cd1e-f979-486b-a8b3-79e95deed08b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:28.668846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8cd1e-f979-486b-a8b3-79e95deed08b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:28.669133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8cd1e-f979-486b-a8b3-79e95deed08b None admin] PATH_INFO: `/v3/users/6feec32199b6443b8606351a9632efd5` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:28.670432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8cd1e-f979-486b-a8b3-79e95deed08b None admin] RBAC: Authorizing `identity:get_user(user_id=6feec32199b6443b8606351a9632efd5)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:28.677808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8cd1e-f979-486b-a8b3-79e95deed08b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:28.679530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 76/146] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:28 2022] GET /identity/v3/users/6feec32199b6443b8606351a9632efd5 => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:28.685077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96398ac1-2bc1-4e2a-a239-06426deeb596 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:28.744590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:28.806495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96398ac1-2bc1-4e2a-a239-06426deeb596 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:28.853628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e3d10-1bd1-4dc8-8736-d056df3c9d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:28.854625 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e3d10-1bd1-4dc8-8736-d056df3c9d32 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:28.855118 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e3d10-1bd1-4dc8-8736-d056df3c9d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:28.855614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e3d10-1bd1-4dc8-8736-d056df3c9d32 None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:28.857029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e3d10-1bd1-4dc8-8736-d056df3c9d32 None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:28.858690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e3d10-1bd1-4dc8-8736-d056df3c9d32 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:28.860590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 71/147] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:28 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:28.868866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8cd1e-f979-486b-a8b3-79e95deed08b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:29.013365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8cd1e-f979-486b-a8b3-79e95deed08b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:29.056840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5919867-120a-4f1b-9403-829a674dc855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:29.057529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5919867-120a-4f1b-9403-829a674dc855 None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:29.057827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5919867-120a-4f1b-9403-829a674dc855 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:29.058109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5919867-120a-4f1b-9403-829a674dc855 None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33/users/6feec32199b6443b8606351a9632efd5/roles/0d4ee04c69134c1b81f17125e1b1c78d` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:29.060116 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5919867-120a-4f1b-9403-829a674dc855 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee4e6637d7984dabbbe2d7d731b48a33, user_id=6feec32199b6443b8606351a9632efd5, role_id=0d4ee04c69134c1b81f17125e1b1c78d)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:29.061573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5919867-120a-4f1b-9403-829a674dc855 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:29.136892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 77/148] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:24:28 2022] PUT /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33/users/6feec32199b6443b8606351a9632efd5/roles/0d4ee04c69134c1b81f17125e1b1c78d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:24:29.496893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12361c5d-13ba-44f8-9443-5b145acfcb08 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:29.497543 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12361c5d-13ba-44f8-9443-5b145acfcb08 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:29.498046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12361c5d-13ba-44f8-9443-5b145acfcb08 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:29.499619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 72/149] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:29.506106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd769dd-6791-4f4c-ab7d-21d26ca97ced None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:29.506394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd769dd-6791-4f4c-ab7d-21d26ca97ced None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:29.506678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd769dd-6791-4f4c-ab7d-21d26ca97ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:29.517138 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:29.532754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-8bd769dd-6791-4f4c-ab7d-21d26ca97ced None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:29.537415 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-8bd769dd-6791-4f4c-ab7d-21d26ca97ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:29.622317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 78/150] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:29.664072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12361c5d-13ba-44f8-9443-5b145acfcb08 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:29.810490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12361c5d-13ba-44f8-9443-5b145acfcb08 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:29.826765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:29.850602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1935902-22d5-4613-9968-cd1ceb38e13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:29.851252 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1935902-22d5-4613-9968-cd1ceb38e13c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:29.851530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1935902-22d5-4613-9968-cd1ceb38e13c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:29.851825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1935902-22d5-4613-9968-cd1ceb38e13c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:29.867603 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1935902-22d5-4613-9968-cd1ceb38e13c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-c1935902-22d5-4613-9968-cd1ceb38e13c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:29.872567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:29.873410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:29.874162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:29.874162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:29.874162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:29.874162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:29.874162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:29.874162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:29.874162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:29.874162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:29.874162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:29.874162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:29.874162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:29.874162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:29.874162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 73/151] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:24:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:29.882892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd769dd-6791-4f4c-ab7d-21d26ca97ced None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:30.037757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd769dd-6791-4f4c-ab7d-21d26ca97ced None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:30.079194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89402be1-1132-404b-b9ac-ee6c00c114a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:30.080199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89402be1-1132-404b-b9ac-ee6c00c114a2 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:30.080684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89402be1-1132-404b-b9ac-ee6c00c114a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:30.081173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89402be1-1132-404b-b9ac-ee6c00c114a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:30.082173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89402be1-1132-404b-b9ac-ee6c00c114a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:30.082675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89402be1-1132-404b-b9ac-ee6c00c114a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:30.084361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89402be1-1132-404b-b9ac-ee6c00c114a2 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:30.086167 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:30.095353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 79/152] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:30.101715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1935902-22d5-4613-9968-cd1ceb38e13c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:30.249008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1935902-22d5-4613-9968-cd1ceb38e13c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:30.284254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b3568-3eb2-4302-9946-bde409e76237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:30.284911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b3568-3eb2-4302-9946-bde409e76237 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:30.285190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b3568-3eb2-4302-9946-bde409e76237 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:30.285461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b3568-3eb2-4302-9946-bde409e76237 None admin] PATH_INFO: `/v3/users/21d88c6eac2e460ca7e17f398e2ce9da` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:30.292503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b3568-3eb2-4302-9946-bde409e76237 None admin] RBAC: Authorizing `identity:get_user(user_id=21d88c6eac2e460ca7e17f398e2ce9da)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:30.294067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b3568-3eb2-4302-9946-bde409e76237 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:30.296109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 74/153] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:30 2022] GET /identity/v3/users/21d88c6eac2e460ca7e17f398e2ce9da => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:30.301342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89402be1-1132-404b-b9ac-ee6c00c114a2 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:30.455583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89402be1-1132-404b-b9ac-ee6c00c114a2 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:30.495346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138665ef-049f-4d2d-baa6-b86ae9cc9d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:30.496020 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138665ef-049f-4d2d-baa6-b86ae9cc9d3a None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:30.496306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138665ef-049f-4d2d-baa6-b86ae9cc9d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:30.496587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138665ef-049f-4d2d-baa6-b86ae9cc9d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:30.575992 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:30.583150 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138665ef-049f-4d2d-baa6-b86ae9cc9d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:30.589196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138665ef-049f-4d2d-baa6-b86ae9cc9d3a None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:30.701032 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 80/154] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:30.706675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b3568-3eb2-4302-9946-bde409e76237 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:30.797931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:30.871491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b3568-3eb2-4302-9946-bde409e76237 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:30.910129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a58989-0522-4da5-a0e8-a733db3d0c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:30.910864 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a58989-0522-4da5-a0e8-a733db3d0c74 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:30.911693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a58989-0522-4da5-a0e8-a733db3d0c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:30.912241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a58989-0522-4da5-a0e8-a733db3d0c74 None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:30.913412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec074b1-c2b6-4496-98b6-763b6984bf5f None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:30.914084 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec074b1-c2b6-4496-98b6-763b6984bf5f None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:30.914084 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec074b1-c2b6-4496-98b6-763b6984bf5f None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:30.915587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 81/155] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:30.916522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a58989-0522-4da5-a0e8-a733db3d0c74 None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:30.918056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a58989-0522-4da5-a0e8-a733db3d0c74 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:30.920054 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 75/156] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:30 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:30.922202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a65b-c55a-40fd-8453-e79710c53dd8 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:30.922493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a65b-c55a-40fd-8453-e79710c53dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:30.922774 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a65b-c55a-40fd-8453-e79710c53dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:30.930897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a58989-0522-4da5-a0e8-a733db3d0c74 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:30.957183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-58d3a65b-c55a-40fd-8453-e79710c53dd8 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:30.958366 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-58d3a65b-c55a-40fd-8453-e79710c53dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:31.067889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 82/157] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:31.121612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3a65b-c55a-40fd-8453-e79710c53dd8 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:31.199307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a58989-0522-4da5-a0e8-a733db3d0c74 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:31.200057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:31.214281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:31.260084 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851a20c-a0da-4173-85b4-c23cae7052db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:31.260721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851a20c-a0da-4173-85b4-c23cae7052db None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:31.261011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851a20c-a0da-4173-85b4-c23cae7052db None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:31.261287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851a20c-a0da-4173-85b4-c23cae7052db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:31.262096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851a20c-a0da-4173-85b4-c23cae7052db None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33, user.id=21d88c6eac2e460ca7e17f398e2ce9da) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:31.262408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851a20c-a0da-4173-85b4-c23cae7052db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:31.263892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851a20c-a0da-4173-85b4-c23cae7052db None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:31.278040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3a65b-c55a-40fd-8453-e79710c53dd8 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:31.281825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 76/158] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:30 2022] GET /identity/v3/role_assignments?user.id=21d88c6eac2e460ca7e17f398e2ce9da&scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 608 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:31.283090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e2087-09d5-4147-8664-0ef540e02e39 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:31.283386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e2087-09d5-4147-8664-0ef540e02e39 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:31.283722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e2087-09d5-4147-8664-0ef540e02e39 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:31.285167 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 77/159] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:31.291624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac09d35-8e86-4377-897a-9adc6bd0a931 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:31.292137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac09d35-8e86-4377-897a-9adc6bd0a931 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:31.292523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac09d35-8e86-4377-897a-9adc6bd0a931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:31.329382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8ac09d35-8e86-4377-897a-9adc6bd0a931 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:31.331516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8ac09d35-8e86-4377-897a-9adc6bd0a931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:31.384309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bfbd5-0500-4e90-953d-4c3e622e45ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:31.384987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bfbd5-0500-4e90-953d-4c3e622e45ce None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:31.385273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bfbd5-0500-4e90-953d-4c3e622e45ce None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:31.385546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bfbd5-0500-4e90-953d-4c3e622e45ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:31.424923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01bfbd5-0500-4e90-953d-4c3e622e45ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-c01bfbd5-0500-4e90-953d-4c3e622e45ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:31.434931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:31.435879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:31.437153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:31.437153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:31.437153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:31.437153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:31.437153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:31.437153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:31.437153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:31.437153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:31.437153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:31.437153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:31.437153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:31.437153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:31.437153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 83/160] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:24:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:24:31.444538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bfbd5-0500-4e90-953d-4c3e622e45ce None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:31.465985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 78/161] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:24:31.490182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5f54c-037d-4fd8-83d9-7a67b180a972 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:31.490483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5f54c-037d-4fd8-83d9-7a67b180a972 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:31.490744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5f54c-037d-4fd8-83d9-7a67b180a972 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:31.492454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 79/162] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:31.507470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942fa68-e744-4962-affb-59ba001e5e74 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:31.507900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942fa68-e744-4962-affb-59ba001e5e74 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:31.508187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942fa68-e744-4962-affb-59ba001e5e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:31.538952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-b942fa68-e744-4962-affb-59ba001e5e74 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:31.540287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b942fa68-e744-4962-affb-59ba001e5e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:31.648176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:31.669172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bfbd5-0500-4e90-953d-4c3e622e45ce None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:31.712508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 80/163] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:24:31.713368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942fa68-e744-4962-affb-59ba001e5e74 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:31.741039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340f941-9fe0-43a2-8ec3-32b4d60342cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:31.741593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340f941-9fe0-43a2-8ec3-32b4d60342cd None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:31.741875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340f941-9fe0-43a2-8ec3-32b4d60342cd None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:31.742149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340f941-9fe0-43a2-8ec3-32b4d60342cd None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:31.742880 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340f941-9fe0-43a2-8ec3-32b4d60342cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:31.743191 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340f941-9fe0-43a2-8ec3-32b4d60342cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:31.745474 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340f941-9fe0-43a2-8ec3-32b4d60342cd None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:31.757409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 84/164] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:24:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:31.758574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340f941-9fe0-43a2-8ec3-32b4d60342cd None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:31.769172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:31.865504 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340f941-9fe0-43a2-8ec3-32b4d60342cd None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:31.892873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942fa68-e744-4962-affb-59ba001e5e74 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:31.901458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480701a-ba3f-41ea-a899-30ab81c97e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:31.902407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480701a-ba3f-41ea-a899-30ab81c97e0d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:31.902906 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480701a-ba3f-41ea-a899-30ab81c97e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:31.903380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480701a-ba3f-41ea-a899-30ab81c97e0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:31.914794 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480701a-ba3f-41ea-a899-30ab81c97e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-2480701a-ba3f-41ea-a899-30ab81c97e0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:31.920951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:31.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:31.922659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:31.922659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:31.922659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:31.922659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:31.922659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:31.922659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:31.922659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:31.922659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:31.922659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:31.922659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:31.922659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:31.922659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:31.924937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 85/165] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:31.926071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480701a-ba3f-41ea-a899-30ab81c97e0d None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:31.938379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:31.985160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884e9b7-2600-48d1-aa2a-b0c381dd0459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:31.986080 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884e9b7-2600-48d1-aa2a-b0c381dd0459 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:31.986531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884e9b7-2600-48d1-aa2a-b0c381dd0459 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:31.987012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884e9b7-2600-48d1-aa2a-b0c381dd0459 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:32.012705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884e9b7-2600-48d1-aa2a-b0c381dd0459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2884e9b7-2600-48d1-aa2a-b0c381dd0459 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:32.018049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:32.018957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:32.019723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:32.019723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:32.019723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:32.019723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:32.019723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:32.019723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:32.019723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:32.019723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:32.019723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:32.019723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:32.019723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:32.019723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:32.029607 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 81/166] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:32.030828 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884e9b7-2600-48d1-aa2a-b0c381dd0459 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:32.035505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480701a-ba3f-41ea-a899-30ab81c97e0d None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:32.075471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2586c-73a3-49ba-ac92-709eecf9f427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:32.076394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2586c-73a3-49ba-ac92-709eecf9f427 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:32.076875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2586c-73a3-49ba-ac92-709eecf9f427 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:32.077423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2586c-73a3-49ba-ac92-709eecf9f427 None admin] PATH_INFO: `/v3/users/0918a4fff7e7494b96471e61efa8a98f` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:32.079242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2586c-73a3-49ba-ac92-709eecf9f427 None admin] RBAC: Authorizing `identity:get_user(user_id=0918a4fff7e7494b96471e61efa8a98f)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:32.081101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2586c-73a3-49ba-ac92-709eecf9f427 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:32.084163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 86/167] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:31 2022] GET /identity/v3/users/0918a4fff7e7494b96471e61efa8a98f => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:32.085263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2586c-73a3-49ba-ac92-709eecf9f427 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:32.171284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:32.197299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2586c-73a3-49ba-ac92-709eecf9f427 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:32.239183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf36876-5fc0-4cd1-a3bf-87aa8d5d73d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:32.240116 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf36876-5fc0-4cd1-a3bf-87aa8d5d73d9 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:32.240544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf36876-5fc0-4cd1-a3bf-87aa8d5d73d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:32.241322 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf36876-5fc0-4cd1-a3bf-87aa8d5d73d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:32.242204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf36876-5fc0-4cd1-a3bf-87aa8d5d73d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:32.242662 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf36876-5fc0-4cd1-a3bf-87aa8d5d73d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:32.244677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf36876-5fc0-4cd1-a3bf-87aa8d5d73d9 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:32.251434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:32.254876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 87/168] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:32.255881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf36876-5fc0-4cd1-a3bf-87aa8d5d73d9 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:32.267692 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884e9b7-2600-48d1-aa2a-b0c381dd0459 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:32.338082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa74790-a3a7-4bf4-b772-b66c82bfaf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:32.338807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa74790-a3a7-4bf4-b772-b66c82bfaf25 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:32.339351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa74790-a3a7-4bf4-b772-b66c82bfaf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:32.339779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa74790-a3a7-4bf4-b772-b66c82bfaf25 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:32.340649 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa74790-a3a7-4bf4-b772-b66c82bfaf25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:32.341092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa74790-a3a7-4bf4-b772-b66c82bfaf25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:32.342623 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa74790-a3a7-4bf4-b772-b66c82bfaf25 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:32.359135 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 82/169] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:32.360215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa74790-a3a7-4bf4-b772-b66c82bfaf25 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:32.371701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf36876-5fc0-4cd1-a3bf-87aa8d5d73d9 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:32.414014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064ddc8-56b7-4a29-9150-07224bb113fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:32.414924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064ddc8-56b7-4a29-9150-07224bb113fb None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:32.415384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064ddc8-56b7-4a29-9150-07224bb113fb None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:32.415832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064ddc8-56b7-4a29-9150-07224bb113fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:32.426284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:32.530176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064ddc8-56b7-4a29-9150-07224bb113fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:32.532099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064ddc8-56b7-4a29-9150-07224bb113fb None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:32.592052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa74790-a3a7-4bf4-b772-b66c82bfaf25 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:32.658018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62d5f9-ad3b-4652-ae3e-ded9aaf73f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:32.658914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62d5f9-ad3b-4652-ae3e-ded9aaf73f11 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:32.659337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62d5f9-ad3b-4652-ae3e-ded9aaf73f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:32.659770 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62d5f9-ad3b-4652-ae3e-ded9aaf73f11 None admin] PATH_INFO: `/v3/users/0918a4fff7e7494b96471e61efa8a98f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:32.662717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62d5f9-ad3b-4652-ae3e-ded9aaf73f11 None admin] RBAC: Authorizing `identity:get_user(user_id=0918a4fff7e7494b96471e61efa8a98f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:32.664368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62d5f9-ad3b-4652-ae3e-ded9aaf73f11 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:32.666243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 83/170] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:32 2022] GET /identity/v3/users/0918a4fff7e7494b96471e61efa8a98f => generated 275 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:32.667137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62d5f9-ad3b-4652-ae3e-ded9aaf73f11 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:32.732365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:32.743617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 88/171] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:32.745834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064ddc8-56b7-4a29-9150-07224bb113fb None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:32.806861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:32.843534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62d5f9-ad3b-4652-ae3e-ded9aaf73f11 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:32.890537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4975b4-2600-49d5-be10-ed4feccc0de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:32.893877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064ddc8-56b7-4a29-9150-07224bb113fb None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:32.894537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4975b4-2600-49d5-be10-ed4feccc0de1 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:32.895384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4975b4-2600-49d5-be10-ed4feccc0de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:32.895887 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4975b4-2600-49d5-be10-ed4feccc0de1 None admin] PATH_INFO: `/v3/users/0918a4fff7e7494b96471e61efa8a98f` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:32.898628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4975b4-2600-49d5-be10-ed4feccc0de1 None admin] RBAC: Authorizing `identity:get_user(user_id=0918a4fff7e7494b96471e61efa8a98f)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:32.900360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4975b4-2600-49d5-be10-ed4feccc0de1 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:32.908714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 84/172] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:32 2022] GET /identity/v3/users/0918a4fff7e7494b96471e61efa8a98f => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:32.910255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a835d3-b54d-44a0-9f2c-6c23084d80f9 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:32.910741 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a835d3-b54d-44a0-9f2c-6c23084d80f9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:32.911299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a835d3-b54d-44a0-9f2c-6c23084d80f9 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:32.913199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 85/173] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:32.917957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a835d3-b54d-44a0-9f2c-6c23084d80f9 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:32.944580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfccd3-bd9b-45bd-a430-f575aace65f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:32.946277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfccd3-bd9b-45bd-a430-f575aace65f4 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:32.946765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfccd3-bd9b-45bd-a430-f575aace65f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:32.947259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfccd3-bd9b-45bd-a430-f575aace65f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.024133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfccd3-bd9b-45bd-a430-f575aace65f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:33.025971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfccd3-bd9b-45bd-a430-f575aace65f4 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:33.048739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:33.080326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a835d3-b54d-44a0-9f2c-6c23084d80f9 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:33.080503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:33.096802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e774f9-a7dd-45b6-90f4-3f3143c94504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:33.097737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e774f9-a7dd-45b6-90f4-3f3143c94504 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.098160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e774f9-a7dd-45b6-90f4-3f3143c94504 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.099112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e774f9-a7dd-45b6-90f4-3f3143c94504 None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.100487 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e774f9-a7dd-45b6-90f4-3f3143c94504 None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:33.102247 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e774f9-a7dd-45b6-90f4-3f3143c94504 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:33.104187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 86/174] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:32 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:33.110929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e774f9-a7dd-45b6-90f4-3f3143c94504 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:33.132665 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 89/175] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:33.133849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b12b4-2a4f-400b-9eba-a95bffa31f3b None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.134208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b12b4-2a4f-400b-9eba-a95bffa31f3b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.134570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b12b4-2a4f-400b-9eba-a95bffa31f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.154550 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-aa7b12b4-2a4f-400b-9eba-a95bffa31f3b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:33.155902 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-aa7b12b4-2a4f-400b-9eba-a95bffa31f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:33.221424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e774f9-a7dd-45b6-90f4-3f3143c94504 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:33.228856 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 90/176] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:33.229179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c44e1a-df91-4efb-a1af-56e76d322eb5 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.229541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c44e1a-df91-4efb-a1af-56e76d322eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.229889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c44e1a-df91-4efb-a1af-56e76d322eb5 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.232284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 91/177] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:33.232284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c44e1a-df91-4efb-a1af-56e76d322eb5 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:33.286491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd126b3-150f-4769-85ff-5fe824cb5e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:33.287842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd126b3-150f-4769-85ff-5fe824cb5e6c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.288372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd126b3-150f-4769-85ff-5fe824cb5e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.288819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd126b3-150f-4769-85ff-5fe824cb5e6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.304679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:33.319643 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:33.343248 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c44e1a-df91-4efb-a1af-56e76d322eb5 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:33.364363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd126b3-150f-4769-85ff-5fe824cb5e6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:33.366406 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd126b3-150f-4769-85ff-5fe824cb5e6c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:33.380232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1dc02-8908-4eef-b2ae-78004d79b014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:33.381149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1dc02-8908-4eef-b2ae-78004d79b014 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.381348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1dc02-8908-4eef-b2ae-78004d79b014 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.381565 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1dc02-8908-4eef-b2ae-78004d79b014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.382372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1dc02-8908-4eef-b2ae-78004d79b014 None admin] RBAC: Adding query filter params (role.id=8595eaa9629b4ec4a628d662402fd25d, scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33, user.id=0918a4fff7e7494b96471e61efa8a98f) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:33.382683 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1dc02-8908-4eef-b2ae-78004d79b014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:33.384324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1dc02-8908-4eef-b2ae-78004d79b014 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:33.390354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 92/178] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:33 2022] GET /identity/v3/role_assignments?user.id=0918a4fff7e7494b96471e61efa8a98f&scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33&role.id=8595eaa9629b4ec4a628d662402fd25d => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:33.391154 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1dc02-8908-4eef-b2ae-78004d79b014 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:33.493950 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 87/179] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:33.495687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1ed8e-9f6a-4abe-a0da-414bfd0afb7b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.496221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1ed8e-9f6a-4abe-a0da-414bfd0afb7b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.496708 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1ed8e-9f6a-4abe-a0da-414bfd0afb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.503883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1dc02-8908-4eef-b2ae-78004d79b014 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:33.517228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c5d1ed8e-9f6a-4abe-a0da-414bfd0afb7b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:33.518745 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c5d1ed8e-9f6a-4abe-a0da-414bfd0afb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:33.536046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:33.543589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b34cb4-bd20-44be-9e94-95009e0eca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:33.544546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b34cb4-bd20-44be-9e94-95009e0eca61 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.545002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b34cb4-bd20-44be-9e94-95009e0eca61 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.545440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b34cb4-bd20-44be-9e94-95009e0eca61 None admin] PATH_INFO: `/v3/projects/52880559ca29410eab86548b79d88fc2` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.548074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b34cb4-bd20-44be-9e94-95009e0eca61 None admin] RBAC: Authorizing `identity:get_project(project_id=52880559ca29410eab86548b79d88fc2)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:33.548881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b34cb4-bd20-44be-9e94-95009e0eca61 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:33.550855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 93/180] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:33 2022] GET /identity/v3/projects/52880559ca29410eab86548b79d88fc2 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:33.552541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b34cb4-bd20-44be-9e94-95009e0eca61 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:33.606189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:33.620637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 88/181] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:33.621513 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1ed8e-9f6a-4abe-a0da-414bfd0afb7b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:33.679011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b34cb4-bd20-44be-9e94-95009e0eca61 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:33.726042 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708b5b9-232c-415a-91f3-4088ceb5ac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:33.726692 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708b5b9-232c-415a-91f3-4088ceb5ac6e None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.726973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708b5b9-232c-415a-91f3-4088ceb5ac6e None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.727246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708b5b9-232c-415a-91f3-4088ceb5ac6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.739673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708b5b9-232c-415a-91f3-4088ceb5ac6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-0708b5b9-232c-415a-91f3-4088ceb5ac6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:33.745457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:33.746320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:33.747098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:33.747098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:33.747098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:33.747098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:33.747098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:33.747098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:33.747098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:33.747098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:33.747098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:33.747098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:33.747098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:33.747098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:33.747098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 94/182] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:33.748773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1ed8e-9f6a-4abe-a0da-414bfd0afb7b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:33.748858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708b5b9-232c-415a-91f3-4088ceb5ac6e None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:33.782857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e684b-0bab-44d3-a811-3d6da93e8c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:33.783504 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e684b-0bab-44d3-a811-3d6da93e8c3f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.783814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e684b-0bab-44d3-a811-3d6da93e8c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.784098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e684b-0bab-44d3-a811-3d6da93e8c3f None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.785260 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e684b-0bab-44d3-a811-3d6da93e8c3f None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:33.787041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e684b-0bab-44d3-a811-3d6da93e8c3f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:33.788739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 89/183] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:33 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:33.789935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057c065-487d-4301-814d-dad3b143f746 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.790165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057c065-487d-4301-814d-dad3b143f746 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.790412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057c065-487d-4301-814d-dad3b143f746 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.791618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 90/184] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:33.792652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d62262-9e40-475e-b450-64eb1998a7d5 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.796903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d62262-9e40-475e-b450-64eb1998a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.796903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d62262-9e40-475e-b450-64eb1998a7d5 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.796903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 91/185] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:33.796903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d62262-9e40-475e-b450-64eb1998a7d5 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:33.817312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:33.853033 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:33.859053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708b5b9-232c-415a-91f3-4088ceb5ac6e None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:33.892783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80943-b630-495e-a36e-2fccdb5f9c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:33.893462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80943-b630-495e-a36e-2fccdb5f9c59 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.893746 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80943-b630-495e-a36e-2fccdb5f9c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.894034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f80943-b630-495e-a36e-2fccdb5f9c59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.894826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80943-b630-495e-a36e-2fccdb5f9c59 None admin] RBAC: Adding query filter params (role.id=59d226afaffe45f597d70faf647f2f22, scope.project.id=52880559ca29410eab86548b79d88fc2, user.id=0918a4fff7e7494b96471e61efa8a98f) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:33.895137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80943-b630-495e-a36e-2fccdb5f9c59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:33.896626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f80943-b630-495e-a36e-2fccdb5f9c59 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:33.897694 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d62262-9e40-475e-b450-64eb1998a7d5 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:33.902404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 95/186] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:33 2022] GET /identity/v3/role_assignments?user.id=0918a4fff7e7494b96471e61efa8a98f&scope.project.id=52880559ca29410eab86548b79d88fc2&role.id=59d226afaffe45f597d70faf647f2f22 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:33.903192 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80943-b630-495e-a36e-2fccdb5f9c59 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:33.936250 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bba372-8ee3-4924-b865-34753eab07a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:33.936920 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bba372-8ee3-4924-b865-34753eab07a5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:33.937205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bba372-8ee3-4924-b865-34753eab07a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:33.937484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bba372-8ee3-4924-b865-34753eab07a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:33.950272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bba372-8ee3-4924-b865-34753eab07a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-48bba372-8ee3-4924-b865-34753eab07a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:33.955451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:33.956457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:33.957551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:33.957551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:33.957551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:33.957551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:33.957551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:33.957551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:33.957551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:33.957551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:33.957551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:33.957551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:33.957551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:33.957551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:33.957551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 92/187] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:24:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:33.958541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bba372-8ee3-4924-b865-34753eab07a5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:34.024752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f80943-b630-495e-a36e-2fccdb5f9c59 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:34.050037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:34.061678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735b55a-4ff7-4716-a101-9bf193c76d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:34.062317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b55a-4ff7-4716-a101-9bf193c76d78 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.062605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b55a-4ff7-4716-a101-9bf193c76d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.062875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735b55a-4ff7-4716-a101-9bf193c76d78 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.064231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735b55a-4ff7-4716-a101-9bf193c76d78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:34.064575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735b55a-4ff7-4716-a101-9bf193c76d78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:34.085555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735b55a-4ff7-4716-a101-9bf193c76d78 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:34.085555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 96/188] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:34.085555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2816c0-fbfb-4077-9ed3-932c55f457a4 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.086733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bba372-8ee3-4924-b865-34753eab07a5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:34.086838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2816c0-fbfb-4077-9ed3-932c55f457a4 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.086838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2816c0-fbfb-4077-9ed3-932c55f457a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.095209 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-cd2816c0-fbfb-4077-9ed3-932c55f457a4 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:34.096446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-cd2816c0-fbfb-4077-9ed3-932c55f457a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:34.098318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:34.125486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72eab66-e2aa-4f62-a989-1058d9f469c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:34.126031 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eab66-e2aa-4f62-a989-1058d9f469c6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.126314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eab66-e2aa-4f62-a989-1058d9f469c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.126598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eab66-e2aa-4f62-a989-1058d9f469c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.127396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72eab66-e2aa-4f62-a989-1058d9f469c6 None admin] RBAC: Adding query filter params (role.id=59d226afaffe45f597d70faf647f2f22, scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33, user.id=0918a4fff7e7494b96471e61efa8a98f) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:34.127704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72eab66-e2aa-4f62-a989-1058d9f469c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:34.129188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72eab66-e2aa-4f62-a989-1058d9f469c6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:34.136525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 93/189] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:33 2022] GET /identity/v3/role_assignments?user.id=0918a4fff7e7494b96471e61efa8a98f&scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33&role.id=59d226afaffe45f597d70faf647f2f22 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:34.137753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec15e5-c600-41ef-9632-7e268da41b94 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.138040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec15e5-c600-41ef-9632-7e268da41b94 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.138314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec15e5-c600-41ef-9632-7e268da41b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.160630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-b8ec15e5-c600-41ef-9632-7e268da41b94 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:34.161698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b8ec15e5-c600-41ef-9632-7e268da41b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:34.176313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 97/190] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:34.178139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2816c0-fbfb-4077-9ed3-932c55f457a4 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:34.247259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 94/191] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:34.248160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec15e5-c600-41ef-9632-7e268da41b94 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:34.313601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2816c0-fbfb-4077-9ed3-932c55f457a4 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:34.334711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:34.356522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35f011-4194-49a5-aeb0-2aa66f5305d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:34.357440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35f011-4194-49a5-aeb0-2aa66f5305d1 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.357723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35f011-4194-49a5-aeb0-2aa66f5305d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.357994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35f011-4194-49a5-aeb0-2aa66f5305d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.360518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35f011-4194-49a5-aeb0-2aa66f5305d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:34.360835 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35f011-4194-49a5-aeb0-2aa66f5305d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:34.362213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35f011-4194-49a5-aeb0-2aa66f5305d1 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:34.373492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 98/192] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:34.374256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35f011-4194-49a5-aeb0-2aa66f5305d1 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:34.374377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec15e5-c600-41ef-9632-7e268da41b94 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:34.390054 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:34.414281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff71955-9a39-4705-bd00-c4944730f95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:34.414921 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71955-9a39-4705-bd00-c4944730f95e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.415209 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71955-9a39-4705-bd00-c4944730f95e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.415482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71955-9a39-4705-bd00-c4944730f95e None admin] PATH_INFO: `/v3/users/6feec32199b6443b8606351a9632efd5` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.416678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff71955-9a39-4705-bd00-c4944730f95e None admin] RBAC: Authorizing `identity:get_user(user_id=6feec32199b6443b8606351a9632efd5)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:34.418137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff71955-9a39-4705-bd00-c4944730f95e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:34.419729 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 95/193] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:34 2022] GET /identity/v3/users/6feec32199b6443b8606351a9632efd5 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:34.420502 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff71955-9a39-4705-bd00-c4944730f95e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:34.473031 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35f011-4194-49a5-aeb0-2aa66f5305d1 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:34.505938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15d0c1-7489-4580-95c2-7debd3d7854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:34.506698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15d0c1-7489-4580-95c2-7debd3d7854b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.506977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15d0c1-7489-4580-95c2-7debd3d7854b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.507249 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15d0c1-7489-4580-95c2-7debd3d7854b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.516991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15d0c1-7489-4580-95c2-7debd3d7854b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-7a15d0c1-7489-4580-95c2-7debd3d7854b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:34.522483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:34.523427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:34.529428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:34.529428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:34.529428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:34.529428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:34.529428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:34.529428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:34.529428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:34.529428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:34.529428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:34.529428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:34.529428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:34.529428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:34.530160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff71955-9a39-4705-bd00-c4944730f95e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:34.530242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 99/194] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:24:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:34.530242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15d0c1-7489-4580-95c2-7debd3d7854b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:34.558653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f105b-c61d-463f-bba7-8fce9051ca69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:34.559289 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f105b-c61d-463f-bba7-8fce9051ca69 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.559568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f105b-c61d-463f-bba7-8fce9051ca69 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.559883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f105b-c61d-463f-bba7-8fce9051ca69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.561057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f105b-c61d-463f-bba7-8fce9051ca69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:34.562507 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f105b-c61d-463f-bba7-8fce9051ca69 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:34.563438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:34.564165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 96/195] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:34.564909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f105b-c61d-463f-bba7-8fce9051ca69 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:34.611684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:34.625677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15d0c1-7489-4580-95c2-7debd3d7854b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:34.659476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a979a34-65e1-43a2-9ae3-6ef7f8a912ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:34.660077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a979a34-65e1-43a2-9ae3-6ef7f8a912ba None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.660362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a979a34-65e1-43a2-9ae3-6ef7f8a912ba None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.660640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a979a34-65e1-43a2-9ae3-6ef7f8a912ba None admin] PATH_INFO: `/v3/users/c2e87de385bd4e81b186a355a8046131` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.664149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f105b-c61d-463f-bba7-8fce9051ca69 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:34.677600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a979a34-65e1-43a2-9ae3-6ef7f8a912ba None admin] RBAC: Authorizing `identity:get_user(user_id=c2e87de385bd4e81b186a355a8046131)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:34.679152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a979a34-65e1-43a2-9ae3-6ef7f8a912ba None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:34.680866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 100/196] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:34 2022] GET /identity/v3/users/c2e87de385bd4e81b186a355a8046131 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:34.681628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a979a34-65e1-43a2-9ae3-6ef7f8a912ba None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:34.703260 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10af2f-becf-4617-a394-1a9c76486e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:34.703913 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10af2f-becf-4617-a394-1a9c76486e88 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.704198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10af2f-becf-4617-a394-1a9c76486e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.704471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10af2f-becf-4617-a394-1a9c76486e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.771371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10af2f-becf-4617-a394-1a9c76486e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:34.772859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10af2f-becf-4617-a394-1a9c76486e88 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:34.775491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:34.781686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a979a34-65e1-43a2-9ae3-6ef7f8a912ba None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:34.818087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c51895-c92b-44d8-8c18-21625391e046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:34.818608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:34.818761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c51895-c92b-44d8-8c18-21625391e046 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.818993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c51895-c92b-44d8-8c18-21625391e046 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.819272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c51895-c92b-44d8-8c18-21625391e046 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.820028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c51895-c92b-44d8-8c18-21625391e046 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:34.820330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c51895-c92b-44d8-8c18-21625391e046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:34.821697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c51895-c92b-44d8-8c18-21625391e046 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:34.829596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 101/197] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:24:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:34.830363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c51895-c92b-44d8-8c18-21625391e046 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:34.873831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 97/198] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:34.873831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10af2f-becf-4617-a394-1a9c76486e88 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:34.933607 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c51895-c92b-44d8-8c18-21625391e046 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:34.967111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e4adc-c47e-4a5c-98eb-b6df63e9a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:34.967730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e4adc-c47e-4a5c-98eb-b6df63e9a68c None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:34.968039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e4adc-c47e-4a5c-98eb-b6df63e9a68c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:34.968323 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e4adc-c47e-4a5c-98eb-b6df63e9a68c None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:34.969009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e4adc-c47e-4a5c-98eb-b6df63e9a68c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:34.970439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e4adc-c47e-4a5c-98eb-b6df63e9a68c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:34.972897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10af2f-becf-4617-a394-1a9c76486e88 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:35.006148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7bb39-35f0-4113-9ea1-bff12bd0171b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:35.006760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7bb39-35f0-4113-9ea1-bff12bd0171b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:35.007041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7bb39-35f0-4113-9ea1-bff12bd0171b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:35.007313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7bb39-35f0-4113-9ea1-bff12bd0171b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:35.022725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:35.073533 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7bb39-35f0-4113-9ea1-bff12bd0171b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:35.075014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7bb39-35f0-4113-9ea1-bff12bd0171b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:35.106801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 102/199] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:24:34 2022] POST /identity/v3/users => generated 297 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:24:35.106801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e4adc-c47e-4a5c-98eb-b6df63e9a68c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:35.125021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:35.187436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 98/200] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:35.188737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7bb39-35f0-4113-9ea1-bff12bd0171b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:35.221496 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e4adc-c47e-4a5c-98eb-b6df63e9a68c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:35.241775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:35.259627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976242c-36d4-45ad-ae24-d7115dd9b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:35.260312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976242c-36d4-45ad-ae24-d7115dd9b0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:35.260589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976242c-36d4-45ad-ae24-d7115dd9b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:35.260859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976242c-36d4-45ad-ae24-d7115dd9b0a7 None admin] PATH_INFO: `/v3/users/c2e87de385bd4e81b186a355a8046131` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:35.262045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976242c-36d4-45ad-ae24-d7115dd9b0a7 None admin] RBAC: Authorizing `identity:get_user(user_id=c2e87de385bd4e81b186a355a8046131)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:35.264216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976242c-36d4-45ad-ae24-d7115dd9b0a7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:35.265964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 103/201] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:35 2022] GET /identity/v3/users/c2e87de385bd4e81b186a355a8046131 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:35.266807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976242c-36d4-45ad-ae24-d7115dd9b0a7 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:35.307573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7bb39-35f0-4113-9ea1-bff12bd0171b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:35.347034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cc631-333b-470d-acdf-15f406bd609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:35.347695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc631-333b-470d-acdf-15f406bd609c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:35.348008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc631-333b-470d-acdf-15f406bd609c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:35.348289 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc631-333b-470d-acdf-15f406bd609c None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:35.350127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cc631-333b-470d-acdf-15f406bd609c None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:35.351610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cc631-333b-470d-acdf-15f406bd609c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:35.353369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 99/202] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:35 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:35.354151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cc631-333b-470d-acdf-15f406bd609c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:35.367993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:35.392886 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976242c-36d4-45ad-ae24-d7115dd9b0a7 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:35.437777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0528d-1cd0-4a56-8b42-f2e6517d2b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:35.438344 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0528d-1cd0-4a56-8b42-f2e6517d2b8b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:35.438931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0528d-1cd0-4a56-8b42-f2e6517d2b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:35.438931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0528d-1cd0-4a56-8b42-f2e6517d2b8b None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:35.440083 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0528d-1cd0-4a56-8b42-f2e6517d2b8b None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:35.441523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0528d-1cd0-4a56-8b42-f2e6517d2b8b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:35.444205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 104/203] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:35 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:35.444813 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0528d-1cd0-4a56-8b42-f2e6517d2b8b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:35.487519 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cc631-333b-470d-acdf-15f406bd609c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:35.511447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:35.541293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599bfb7-5d74-4437-b547-3e143515c394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:35.542363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599bfb7-5d74-4437-b547-3e143515c394 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:35.542915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599bfb7-5d74-4437-b547-3e143515c394 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:35.543409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599bfb7-5d74-4437-b547-3e143515c394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:35.577396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0528d-1cd0-4a56-8b42-f2e6517d2b8b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:35.627061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610a300-2129-462e-8983-bb0262502428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:35.628737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610a300-2129-462e-8983-bb0262502428 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:35.629224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610a300-2129-462e-8983-bb0262502428 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:35.629694 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610a300-2129-462e-8983-bb0262502428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:35.630733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610a300-2129-462e-8983-bb0262502428 None admin] RBAC: Adding query filter params (role.id=0d4ee04c69134c1b81f17125e1b1c78d, scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33, user.id=6feec32199b6443b8606351a9632efd5) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:35.631509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610a300-2129-462e-8983-bb0262502428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:35.634107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610a300-2129-462e-8983-bb0262502428 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:35.634619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599bfb7-5d74-4437-b547-3e143515c394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:35.636111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599bfb7-5d74-4437-b547-3e143515c394 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:35.642215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 105/204] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:35 2022] GET /identity/v3/role_assignments?user.id=6feec32199b6443b8606351a9632efd5&scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33&role.id=0d4ee04c69134c1b81f17125e1b1c78d => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:35.643311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610a300-2129-462e-8983-bb0262502428 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:35.667930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:35.768350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 100/205] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:35.775821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599bfb7-5d74-4437-b547-3e143515c394 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:35.794418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:35.828656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610a300-2129-462e-8983-bb0262502428 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:35.877328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dffe0b-5e15-4491-9f0c-d1f31f79adbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:35.879280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dffe0b-5e15-4491-9f0c-d1f31f79adbd None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:35.879280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dffe0b-5e15-4491-9f0c-d1f31f79adbd None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:35.879484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dffe0b-5e15-4491-9f0c-d1f31f79adbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:35.881114 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dffe0b-5e15-4491-9f0c-d1f31f79adbd None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=afcb05e9da4b4207af59800fe02b4346, user.id=c2e87de385bd4e81b186a355a8046131) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:35.881528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dffe0b-5e15-4491-9f0c-d1f31f79adbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:35.883385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dffe0b-5e15-4491-9f0c-d1f31f79adbd None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:35.888885 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 106/206] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:35 2022] GET /identity/v3/role_assignments?user.id=c2e87de385bd4e81b186a355a8046131&scope.project.id=afcb05e9da4b4207af59800fe02b4346&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:35.930785 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599bfb7-5d74-4437-b547-3e143515c394 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:35.975535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d1e69-5d93-4805-a9e1-f728caed0604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:35.976918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d1e69-5d93-4805-a9e1-f728caed0604 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:35.977348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d1e69-5d93-4805-a9e1-f728caed0604 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:35.977786 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d1e69-5d93-4805-a9e1-f728caed0604 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:35.979227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d1e69-5d93-4805-a9e1-f728caed0604 None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:35.980923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d1e69-5d93-4805-a9e1-f728caed0604 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:35.982869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 101/207] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:35 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:35.989630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dffe0b-5e15-4491-9f0c-d1f31f79adbd None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:36.092217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:36.115401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dffe0b-5e15-4491-9f0c-d1f31f79adbd None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:36.151353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8a7fe-24fd-4631-860b-5f8d7e861b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:36.152030 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a7fe-24fd-4631-860b-5f8d7e861b9e None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:36.152327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a7fe-24fd-4631-860b-5f8d7e861b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:36.152609 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a7fe-24fd-4631-860b-5f8d7e861b9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:36.153419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8a7fe-24fd-4631-860b-5f8d7e861b9e None admin] RBAC: Adding query filter params (role.id=8595eaa9629b4ec4a628d662402fd25d, scope.project.id=afcb05e9da4b4207af59800fe02b4346, user.id=c2e87de385bd4e81b186a355a8046131) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:36.153728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8a7fe-24fd-4631-860b-5f8d7e861b9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:36.155164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8a7fe-24fd-4631-860b-5f8d7e861b9e None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:36.161576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 107/208] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:35 2022] GET /identity/v3/role_assignments?user.id=c2e87de385bd4e81b186a355a8046131&scope.project.id=afcb05e9da4b4207af59800fe02b4346&role.id=8595eaa9629b4ec4a628d662402fd25d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:37.332330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474da95b-81d3-47bc-aa3e-59d7ab3e42f4 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:37.333221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474da95b-81d3-47bc-aa3e-59d7ab3e42f4 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:37.333668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474da95b-81d3-47bc-aa3e-59d7ab3e42f4 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:37.335424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 102/209] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:37.340876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669982d-8709-4df6-ae27-50878a4bb803 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:37.341678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669982d-8709-4df6-ae27-50878a4bb803 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:37.342175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669982d-8709-4df6-ae27-50878a4bb803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:37.360707 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-5669982d-8709-4df6-ae27-50878a4bb803 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:37.362214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-5669982d-8709-4df6-ae27-50878a4bb803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:37.433645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 108/210] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:37.457528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474da95b-81d3-47bc-aa3e-59d7ab3e42f4 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:37.472103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d72f80-6152-418e-b862-1f28ada4c553 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:37.472408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d72f80-6152-418e-b862-1f28ada4c553 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:37.472662 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d72f80-6152-418e-b862-1f28ada4c553 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:37.474334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 109/211] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:24:37.479585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9c089-72dd-4fd5-911f-3524ee4ebd30 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:37.479903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9c089-72dd-4fd5-911f-3524ee4ebd30 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:37.480178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9c089-72dd-4fd5-911f-3524ee4ebd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:37.499319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-e0d9c089-72dd-4fd5-911f-3524ee4ebd30 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:37.500541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-e0d9c089-72dd-4fd5-911f-3524ee4ebd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:37.554921 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:37.580437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 110/212] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:24:37.581997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474da95b-81d3-47bc-aa3e-59d7ab3e42f4 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:37.605922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9c089-72dd-4fd5-911f-3524ee4ebd30 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:37.608029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:37.625736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b218e0-beee-423b-9dbd-7dace1df2944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:37.626937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b218e0-beee-423b-9dbd-7dace1df2944 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:37.627405 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b218e0-beee-423b-9dbd-7dace1df2944 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:37.627920 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b218e0-beee-423b-9dbd-7dace1df2944 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:37.642360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b218e0-beee-423b-9dbd-7dace1df2944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-e6b218e0-beee-423b-9dbd-7dace1df2944 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:37.653035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:37.653917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:37.654678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:37.654678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:37.654678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:37.654678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:37.654678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:37.654678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:37.654678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:37.654678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:37.654678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:37.654678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:37.654678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:37.654678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:37.656954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 103/213] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:37.663637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b218e0-beee-423b-9dbd-7dace1df2944 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:37.728301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9c089-72dd-4fd5-911f-3524ee4ebd30 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:37.765289 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c345a0-09ee-4552-83e1-858e0856be2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:37.766108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c345a0-09ee-4552-83e1-858e0856be2b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:37.766488 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c345a0-09ee-4552-83e1-858e0856be2b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:37.766870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c345a0-09ee-4552-83e1-858e0856be2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:37.768226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c345a0-09ee-4552-83e1-858e0856be2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:37.769736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c345a0-09ee-4552-83e1-858e0856be2b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:37.771780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 111/214] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:37.777051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c345a0-09ee-4552-83e1-858e0856be2b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:37.777450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b218e0-beee-423b-9dbd-7dace1df2944 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:37.815315 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec5a1e-465b-48e9-a438-584d47a49214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:37.816658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec5a1e-465b-48e9-a438-584d47a49214 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:37.816658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec5a1e-465b-48e9-a438-584d47a49214 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:37.816658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec5a1e-465b-48e9-a438-584d47a49214 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:37.817681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec5a1e-465b-48e9-a438-584d47a49214 None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:37.818106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec5a1e-465b-48e9-a438-584d47a49214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:37.819591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec5a1e-465b-48e9-a438-584d47a49214 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:37.833452 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 104/215] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:37.834508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec5a1e-465b-48e9-a438-584d47a49214 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:37.838308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:37.855368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:37.888539 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c345a0-09ee-4552-83e1-858e0856be2b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:37.925480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6636cd-05b9-4b67-aca6-cdecc8fec948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:37.926453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6636cd-05b9-4b67-aca6-cdecc8fec948 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:37.927478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6636cd-05b9-4b67-aca6-cdecc8fec948 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:37.928141 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6636cd-05b9-4b67-aca6-cdecc8fec948 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:37.929026 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6636cd-05b9-4b67-aca6-cdecc8fec948 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:37.930673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6636cd-05b9-4b67-aca6-cdecc8fec948 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:37.944156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec5a1e-465b-48e9-a438-584d47a49214 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:37.980017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c011de-9573-4fb6-94b1-1468de1705df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:37.980671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c011de-9573-4fb6-94b1-1468de1705df None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:37.980955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c011de-9573-4fb6-94b1-1468de1705df None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:37.981232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c011de-9573-4fb6-94b1-1468de1705df None admin] PATH_INFO: `/v3/users/3d9b576fea594f2d9363ff739204d91d` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:37.996059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c011de-9573-4fb6-94b1-1468de1705df None admin] RBAC: Authorizing `identity:get_user(user_id=3d9b576fea594f2d9363ff739204d91d)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:37.997558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c011de-9573-4fb6-94b1-1468de1705df None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:37.999478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 105/216] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:37 2022] GET /identity/v3/users/3d9b576fea594f2d9363ff739204d91d => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:38.002612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5e96c-29c9-4f64-a074-0c8d5d98be83 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.002952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5e96c-29c9-4f64-a074-0c8d5d98be83 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.003237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5e96c-29c9-4f64-a074-0c8d5d98be83 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.004644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 106/217] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:24:38.005333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5e96c-29c9-4f64-a074-0c8d5d98be83 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:38.022175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 112/218] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:24:37 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:24:38.029276 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c09a7-ac58-4536-ae96-63727b37a566 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.029573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c09a7-ac58-4536-ae96-63727b37a566 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.029852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c09a7-ac58-4536-ae96-63727b37a566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.068924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-eb0c09a7-ac58-4536-ae96-63727b37a566 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:38.071439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-eb0c09a7-ac58-4536-ae96-63727b37a566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:38.089514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:38.142874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5e96c-29c9-4f64-a074-0c8d5d98be83 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:38.167120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 113/219] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:38.191691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c09a7-ac58-4536-ae96-63727b37a566 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:38.194776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866762b-699f-487d-b088-8d25801d1853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:38.195543 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866762b-699f-487d-b088-8d25801d1853 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.196658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866762b-699f-487d-b088-8d25801d1853 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.196658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866762b-699f-487d-b088-8d25801d1853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.260114 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:38.278639 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866762b-699f-487d-b088-8d25801d1853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:38.280154 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866762b-699f-487d-b088-8d25801d1853 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:38.310361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c09a7-ac58-4536-ae96-63727b37a566 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:38.355279 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:38.363080 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80288f6-e51a-4af9-a87d-c4bcf0404425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:38.363941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80288f6-e51a-4af9-a87d-c4bcf0404425 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.364882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80288f6-e51a-4af9-a87d-c4bcf0404425 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80288f6-e51a-4af9-a87d-c4bcf0404425 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.383451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80288f6-e51a-4af9-a87d-c4bcf0404425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-c80288f6-e51a-4af9-a87d-c4bcf0404425 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:38.388564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:38.389441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:38.390695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:38.390695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:38.390695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:38.390695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:38.390695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:38.390695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:38.390695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:38.390695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:38.390695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:38.390695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:38.390695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:38.390695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:38.390695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 114/220] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:24:38.391613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d605a-242c-4d05-9685-e4009c8baa7f None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.391613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d605a-242c-4d05-9685-e4009c8baa7f None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.391613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d605a-242c-4d05-9685-e4009c8baa7f None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.394376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 115/221] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:38.398442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d605a-242c-4d05-9685-e4009c8baa7f None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:38.414717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 107/222] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:38.416093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c162e-4b1c-4dd9-a07a-594fc3c0ba1a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.416386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c162e-4b1c-4dd9-a07a-594fc3c0ba1a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.416661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c162e-4b1c-4dd9-a07a-594fc3c0ba1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.440840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-825c162e-4b1c-4dd9-a07a-594fc3c0ba1a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:38.442522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-825c162e-4b1c-4dd9-a07a-594fc3c0ba1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:38.524782 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 108/223] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:38.528654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c162e-4b1c-4dd9-a07a-594fc3c0ba1a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:38.545731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d605a-242c-4d05-9685-e4009c8baa7f None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:38.566787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:38.585611 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3d121-9c6e-42bd-a5c9-4f4a31988329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:38.586238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3d121-9c6e-42bd-a5c9-4f4a31988329 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.586520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3d121-9c6e-42bd-a5c9-4f4a31988329 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.586791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3d121-9c6e-42bd-a5c9-4f4a31988329 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.587514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3d121-9c6e-42bd-a5c9-4f4a31988329 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:38.587844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3d121-9c6e-42bd-a5c9-4f4a31988329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:38.589225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3d121-9c6e-42bd-a5c9-4f4a31988329 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:38.600326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 116/224] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:38.601179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3d121-9c6e-42bd-a5c9-4f4a31988329 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:38.647699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:38.660609 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c162e-4b1c-4dd9-a07a-594fc3c0ba1a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:38.711489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344000a-f46e-4971-87ae-d03bb7811814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:38.712686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344000a-f46e-4971-87ae-d03bb7811814 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.713398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344000a-f46e-4971-87ae-d03bb7811814 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.713825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344000a-f46e-4971-87ae-d03bb7811814 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.715885 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344000a-f46e-4971-87ae-d03bb7811814 None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:38.718532 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344000a-f46e-4971-87ae-d03bb7811814 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:38.721335 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 109/225] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:38.722265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344000a-f46e-4971-87ae-d03bb7811814 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:38.723347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3d121-9c6e-42bd-a5c9-4f4a31988329 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:38.761373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953e7da-848d-4c11-b627-78cbb61fef1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:38.762016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e7da-848d-4c11-b627-78cbb61fef1f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.762299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e7da-848d-4c11-b627-78cbb61fef1f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.762574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953e7da-848d-4c11-b627-78cbb61fef1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.774254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953e7da-848d-4c11-b627-78cbb61fef1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-a953e7da-848d-4c11-b627-78cbb61fef1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:38.780772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:38.781852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:38.782725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:38.782725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:38.782725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:38.782725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:38.782725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:38.782725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:38.782725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:38.782725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:38.782725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:38.782725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:38.782725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:38.782725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:38.787465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 117/226] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:38.788355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953e7da-848d-4c11-b627-78cbb61fef1f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:38.839898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:38.847625 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344000a-f46e-4971-87ae-d03bb7811814 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:38.886185 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4085e-0c3c-4e76-aaa8-dff7bc115485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:38.886990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4085e-0c3c-4e76-aaa8-dff7bc115485 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.887375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4085e-0c3c-4e76-aaa8-dff7bc115485 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.887775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4085e-0c3c-4e76-aaa8-dff7bc115485 None admin] PATH_INFO: `/v3/users/c2e87de385bd4e81b186a355a8046131` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.889246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4085e-0c3c-4e76-aaa8-dff7bc115485 None admin] RBAC: Authorizing `identity:get_user(user_id=c2e87de385bd4e81b186a355a8046131)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:38.890977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4085e-0c3c-4e76-aaa8-dff7bc115485 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:38.898051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 110/227] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/users/c2e87de385bd4e81b186a355a8046131 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:38.898051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4085e-0c3c-4e76-aaa8-dff7bc115485 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:38.922834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953e7da-848d-4c11-b627-78cbb61fef1f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:38.928725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:38.972560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b0ca0-d745-42ab-b054-66e54b3b438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:38.974213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b0ca0-d745-42ab-b054-66e54b3b438c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:38.974665 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b0ca0-d745-42ab-b054-66e54b3b438c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:38.975100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b0ca0-d745-42ab-b054-66e54b3b438c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:38.976579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b0ca0-d745-42ab-b054-66e54b3b438c None admin] RBAC: Adding query filter params (role.id=59d226afaffe45f597d70faf647f2f22, scope.project.id=afcb05e9da4b4207af59800fe02b4346, user.id=3d9b576fea594f2d9363ff739204d91d) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:38.977314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b0ca0-d745-42ab-b054-66e54b3b438c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:38.979077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b0ca0-d745-42ab-b054-66e54b3b438c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:38.986247 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 118/228] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/role_assignments?user.id=3d9b576fea594f2d9363ff739204d91d&scope.project.id=afcb05e9da4b4207af59800fe02b4346&role.id=59d226afaffe45f597d70faf647f2f22 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:38.987632 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b0ca0-d745-42ab-b054-66e54b3b438c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:39.014682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4085e-0c3c-4e76-aaa8-dff7bc115485 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:39.056164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240028d-82cc-4692-9ba5-06d52c36a129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:39.056963 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240028d-82cc-4692-9ba5-06d52c36a129 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:39.057363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240028d-82cc-4692-9ba5-06d52c36a129 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:39.057759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240028d-82cc-4692-9ba5-06d52c36a129 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:39.058621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240028d-82cc-4692-9ba5-06d52c36a129 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:39.059173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240028d-82cc-4692-9ba5-06d52c36a129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:39.060699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240028d-82cc-4692-9ba5-06d52c36a129 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:39.070928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 111/229] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:39.076798 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240028d-82cc-4692-9ba5-06d52c36a129 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:39.136585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b0ca0-d745-42ab-b054-66e54b3b438c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:39.138949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:39.199166 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:39.204266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfa906-ac38-4fcb-85fd-82e478603cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:39.204938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfa906-ac38-4fcb-85fd-82e478603cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:39.205218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfa906-ac38-4fcb-85fd-82e478603cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:39.205492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfa906-ac38-4fcb-85fd-82e478603cd7 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:39.210208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfa906-ac38-4fcb-85fd-82e478603cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:39.212859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfa906-ac38-4fcb-85fd-82e478603cd7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:39.222587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 119/230] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:38 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:39.222720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240028d-82cc-4692-9ba5-06d52c36a129 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:39.222800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfa906-ac38-4fcb-85fd-82e478603cd7 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:39.289675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9920a-398f-438f-932e-b1c14faa7e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:39.290449 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9920a-398f-438f-932e-b1c14faa7e21 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:39.290742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9920a-398f-438f-932e-b1c14faa7e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:39.291120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9920a-398f-438f-932e-b1c14faa7e21 None admin] PATH_INFO: `/v3/users/c2e87de385bd4e81b186a355a8046131` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:39.294255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9920a-398f-438f-932e-b1c14faa7e21 None admin] RBAC: Authorizing `identity:get_user(user_id=c2e87de385bd4e81b186a355a8046131)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:39.295724 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9920a-398f-438f-932e-b1c14faa7e21 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:39.297778 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 112/231] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:39 2022] GET /identity/v3/users/c2e87de385bd4e81b186a355a8046131 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:39.303816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9920a-398f-438f-932e-b1c14faa7e21 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:39.351059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfa906-ac38-4fcb-85fd-82e478603cd7 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:39.423634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff2730-c84b-480c-bc0f-5a6f82f59fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:39.424377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff2730-c84b-480c-bc0f-5a6f82f59fa3 None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:39.424618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff2730-c84b-480c-bc0f-5a6f82f59fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:39.424889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff2730-c84b-480c-bc0f-5a6f82f59fa3 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346/users/c2e87de385bd4e81b186a355a8046131/roles/11da9ce3f79148679dbde9eb2c568e55` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:39.428474 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff2730-c84b-480c-bc0f-5a6f82f59fa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=afcb05e9da4b4207af59800fe02b4346, user_id=c2e87de385bd4e81b186a355a8046131, role_id=11da9ce3f79148679dbde9eb2c568e55)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:39.429925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff2730-c84b-480c-bc0f-5a6f82f59fa3 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:39.469213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9920a-398f-438f-932e-b1c14faa7e21 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:39.507242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14625c7-b09e-4025-a1f8-c8e208757ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:39.507925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14625c7-b09e-4025-a1f8-c8e208757ecc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:39.508227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14625c7-b09e-4025-a1f8-c8e208757ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:39.508490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14625c7-b09e-4025-a1f8-c8e208757ecc None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:39.509780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14625c7-b09e-4025-a1f8-c8e208757ecc None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:39.514159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14625c7-b09e-4025-a1f8-c8e208757ecc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:39.514159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 113/232] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:39 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:39.518880 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14625c7-b09e-4025-a1f8-c8e208757ecc None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:39.546722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 120/233] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:24:39 2022] PUT /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346/users/c2e87de385bd4e81b186a355a8046131/roles/11da9ce3f79148679dbde9eb2c568e55 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:24:39.561465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:39.670463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14625c7-b09e-4025-a1f8-c8e208757ecc None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:39.725699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1749a04-1624-407d-85ae-d74699c3bacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:39.726350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1749a04-1624-407d-85ae-d74699c3bacb None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:39.726643 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1749a04-1624-407d-85ae-d74699c3bacb None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:39.727033 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1749a04-1624-407d-85ae-d74699c3bacb None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346/users/c2e87de385bd4e81b186a355a8046131/roles/8595eaa9629b4ec4a628d662402fd25d` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:39.733847 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1749a04-1624-407d-85ae-d74699c3bacb None admin] RBAC: Authorizing `identity:create_grant(project_id=afcb05e9da4b4207af59800fe02b4346, user_id=c2e87de385bd4e81b186a355a8046131, role_id=8595eaa9629b4ec4a628d662402fd25d)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:39.735330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1749a04-1624-407d-85ae-d74699c3bacb None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:39.862745 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 114/234] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:24:39 2022] PUT /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346/users/c2e87de385bd4e81b186a355a8046131/roles/8595eaa9629b4ec4a628d662402fd25d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:24:40.354497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfb963-1c8d-408b-87fe-9503b01ea213 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:40.355127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfb963-1c8d-408b-87fe-9503b01ea213 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:40.355630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfb963-1c8d-408b-87fe-9503b01ea213 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:40.357503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 121/235] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:40.362868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b72e-0678-4af8-9fd2-aac289a58349 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:40.363387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b72e-0678-4af8-9fd2-aac289a58349 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:40.364426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b72e-0678-4af8-9fd2-aac289a58349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:40.383619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-5101b72e-0678-4af8-9fd2-aac289a58349 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:40.385177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5101b72e-0678-4af8-9fd2-aac289a58349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:40.461383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 115/236] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:24:40.486781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfb963-1c8d-408b-87fe-9503b01ea213 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:40.519491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:40.568218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd85f7-4ee1-4db6-8f8e-ce5039dd6077 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:40.569161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd85f7-4ee1-4db6-8f8e-ce5039dd6077 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:40.569638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd85f7-4ee1-4db6-8f8e-ce5039dd6077 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:40.571491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 116/237] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:40.576615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b134a8-78eb-4fa4-ae94-8b1d5bc87228 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:40.577150 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b134a8-78eb-4fa4-ae94-8b1d5bc87228 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:40.577647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b134a8-78eb-4fa4-ae94-8b1d5bc87228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:40.604371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f3b134a8-78eb-4fa4-ae94-8b1d5bc87228 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:40.607348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f3b134a8-78eb-4fa4-ae94-8b1d5bc87228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:40.629965 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:40.644148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfb963-1c8d-408b-87fe-9503b01ea213 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:40.714652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 117/238] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:40.733016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29301539-10c0-46aa-a2af-fed239e3b685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:40.733684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29301539-10c0-46aa-a2af-fed239e3b685 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:40.733966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29301539-10c0-46aa-a2af-fed239e3b685 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:40.734246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29301539-10c0-46aa-a2af-fed239e3b685 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:40.736494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29301539-10c0-46aa-a2af-fed239e3b685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:40.737971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29301539-10c0-46aa-a2af-fed239e3b685 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:40.740739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b134a8-78eb-4fa4-ae94-8b1d5bc87228 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:40.743838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 122/239] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:40.754030 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29301539-10c0-46aa-a2af-fed239e3b685 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:40.876666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:40.882152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29301539-10c0-46aa-a2af-fed239e3b685 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:40.903591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b134a8-78eb-4fa4-ae94-8b1d5bc87228 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:40.920095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce5b93-b28b-4143-af4e-09077f0d786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:40.920714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5b93-b28b-4143-af4e-09077f0d786d None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:40.920988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5b93-b28b-4143-af4e-09077f0d786d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:40.921257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5b93-b28b-4143-af4e-09077f0d786d None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:40.921946 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce5b93-b28b-4143-af4e-09077f0d786d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:40.923374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce5b93-b28b-4143-af4e-09077f0d786d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:40.955659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce375b4e-f0dd-45b3-b3ad-c7b06885e33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:40.956337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce375b4e-f0dd-45b3-b3ad-c7b06885e33c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:40.956622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce375b4e-f0dd-45b3-b3ad-c7b06885e33c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:40.956899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce375b4e-f0dd-45b3-b3ad-c7b06885e33c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:40.968689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce375b4e-f0dd-45b3-b3ad-c7b06885e33c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ce375b4e-f0dd-45b3-b3ad-c7b06885e33c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:40.973995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:40.974870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:40.975652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:40.975652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:40.975652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:40.975652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:40.975652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:40.975652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:40.975652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:40.975652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:40.975652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:40.975652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:40.975652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:40.975652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:40.975652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 118/240] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:40.984870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce375b4e-f0dd-45b3-b3ad-c7b06885e33c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:40.996699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:41.011859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 123/241] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:24:40 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:24:41.158691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce375b4e-f0dd-45b3-b3ad-c7b06885e33c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:41.210401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc85d9b-4891-48cb-b4b8-2a6c1dac5d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:41.211333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85d9b-4891-48cb-b4b8-2a6c1dac5d56 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:41.211821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85d9b-4891-48cb-b4b8-2a6c1dac5d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:41.212272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85d9b-4891-48cb-b4b8-2a6c1dac5d56 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:41.213196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc85d9b-4891-48cb-b4b8-2a6c1dac5d56 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:41.213675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc85d9b-4891-48cb-b4b8-2a6c1dac5d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:41.215239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc85d9b-4891-48cb-b4b8-2a6c1dac5d56 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:41.227045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 119/242] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:41.232745 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce5b93-b28b-4143-af4e-09077f0d786d None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:41.338008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce5b93-b28b-4143-af4e-09077f0d786d None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:41.378327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8eebdd-d5c6-4c49-a80c-aed01a8eb6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:41.378983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8eebdd-d5c6-4c49-a80c-aed01a8eb6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:41.379266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8eebdd-d5c6-4c49-a80c-aed01a8eb6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:41.380192 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8eebdd-d5c6-4c49-a80c-aed01a8eb6c1 None admin] PATH_INFO: `/v3/users/11ff5eb80cc04047ab4517bac064be34` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:41.388013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7275f-060d-442a-a107-3974473148a5 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:41.388303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7275f-060d-442a-a107-3974473148a5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:41.388580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7275f-060d-442a-a107-3974473148a5 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:41.389931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 120/243] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:24:41.399091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a849267-bcfb-46f0-8f74-46d99f6863e9 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:41.399380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a849267-bcfb-46f0-8f74-46d99f6863e9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:41.399647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a849267-bcfb-46f0-8f74-46d99f6863e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:41.405403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8eebdd-d5c6-4c49-a80c-aed01a8eb6c1 None admin] RBAC: Authorizing `identity:get_user(user_id=11ff5eb80cc04047ab4517bac064be34)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:41.407071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8eebdd-d5c6-4c49-a80c-aed01a8eb6c1 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:41.409367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 124/244] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:41 2022] GET /identity/v3/users/11ff5eb80cc04047ab4517bac064be34 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:41.418532 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8eebdd-d5c6-4c49-a80c-aed01a8eb6c1 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:41.427539 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-7a849267-bcfb-46f0-8f74-46d99f6863e9 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:41.428837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7a849267-bcfb-46f0-8f74-46d99f6863e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:41.441156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:41.532076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:41.541318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 121/245] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:41.561427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8eebdd-d5c6-4c49-a80c-aed01a8eb6c1 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:41.571188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a849267-bcfb-46f0-8f74-46d99f6863e9 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:41.608030 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a972ef8-5810-4696-942a-bf193bb7ac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:41.609201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a972ef8-5810-4696-942a-bf193bb7ac3c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:41.610003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a972ef8-5810-4696-942a-bf193bb7ac3c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:41.610686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a972ef8-5810-4696-942a-bf193bb7ac3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:41.705300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a972ef8-5810-4696-942a-bf193bb7ac3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:41.707221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a972ef8-5810-4696-942a-bf193bb7ac3c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:41.716521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a849267-bcfb-46f0-8f74-46d99f6863e9 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:41.726285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:41.763442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938681c3-982c-4a23-91e4-295f3d5d995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:41.764760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938681c3-982c-4a23-91e4-295f3d5d995b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:41.765216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938681c3-982c-4a23-91e4-295f3d5d995b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:41.765636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938681c3-982c-4a23-91e4-295f3d5d995b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:41.779828 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938681c3-982c-4a23-91e4-295f3d5d995b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-938681c3-982c-4a23-91e4-295f3d5d995b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:41.787008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:41.787947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:41.788733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:41.788733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:41.788733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:41.788733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:41.788733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:41.788733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:41.788733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:41.788733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:41.788733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:41.788733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:41.788733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:41.788733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:41.789390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 122/246] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:41.796063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938681c3-982c-4a23-91e4-295f3d5d995b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:41.874557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 125/247] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:24:41.878696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a972ef8-5810-4696-942a-bf193bb7ac3c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:41.906534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:41.974655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938681c3-982c-4a23-91e4-295f3d5d995b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:42.042520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a972ef8-5810-4696-942a-bf193bb7ac3c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:42.048474 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b85a7-e6f1-4b42-af4f-75577ee8ae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:42.049122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b85a7-e6f1-4b42-af4f-75577ee8ae26 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.049408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b85a7-e6f1-4b42-af4f-75577ee8ae26 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.049686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b85a7-e6f1-4b42-af4f-75577ee8ae26 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.050432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b85a7-e6f1-4b42-af4f-75577ee8ae26 None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:42.050742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b85a7-e6f1-4b42-af4f-75577ee8ae26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:42.052838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b85a7-e6f1-4b42-af4f-75577ee8ae26 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:42.056956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:42.071348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 123/248] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:42.078163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b85a7-e6f1-4b42-af4f-75577ee8ae26 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:42.087252 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86548f12-3f38-41da-a385-19fca8ceea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:42.088570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548f12-3f38-41da-a385-19fca8ceea29 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.089510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548f12-3f38-41da-a385-19fca8ceea29 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.090008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548f12-3f38-41da-a385-19fca8ceea29 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.091968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86548f12-3f38-41da-a385-19fca8ceea29 None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:42.094125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86548f12-3f38-41da-a385-19fca8ceea29 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:42.096768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 126/249] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:41 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:42.098919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b7108-b804-4b2f-9bab-fe2363736d19 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.104462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b7108-b804-4b2f-9bab-fe2363736d19 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.104462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b7108-b804-4b2f-9bab-fe2363736d19 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.104462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 127/250] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:42.107330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b7108-b804-4b2f-9bab-fe2363736d19 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:42.260506 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b85a7-e6f1-4b42-af4f-75577ee8ae26 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:42.292901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:42.296825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b7108-b804-4b2f-9bab-fe2363736d19 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:42.324047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c6eb0-be8a-4693-b341-a96b6cb65256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:42.324705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6eb0-be8a-4693-b341-a96b6cb65256 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.324989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6eb0-be8a-4693-b341-a96b6cb65256 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.325320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6eb0-be8a-4693-b341-a96b6cb65256 None admin] PATH_INFO: `/v3/users/3d9b576fea594f2d9363ff739204d91d` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.326578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c6eb0-be8a-4693-b341-a96b6cb65256 None admin] RBAC: Authorizing `identity:get_user(user_id=3d9b576fea594f2d9363ff739204d91d)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:42.328057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c6eb0-be8a-4693-b341-a96b6cb65256 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:42.330641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 124/251] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:42 2022] GET /identity/v3/users/3d9b576fea594f2d9363ff739204d91d => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:42.331948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a050-b037-45e3-b12a-752e180cc30c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.332333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a050-b037-45e3-b12a-752e180cc30c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.332646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a050-b037-45e3-b12a-752e180cc30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.365114 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed64738-0096-4e12-bac8-84fb5f5480c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:42.365738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed64738-0096-4e12-bac8-84fb5f5480c7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.366019 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed64738-0096-4e12-bac8-84fb5f5480c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.366289 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed64738-0096-4e12-bac8-84fb5f5480c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.367105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed64738-0096-4e12-bac8-84fb5f5480c7 None admin] RBAC: Adding query filter params (role.id=0d4ee04c69134c1b81f17125e1b1c78d, scope.project.id=afcb05e9da4b4207af59800fe02b4346, user.id=11ff5eb80cc04047ab4517bac064be34) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:42.367413 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed64738-0096-4e12-bac8-84fb5f5480c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:42.369528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed64738-0096-4e12-bac8-84fb5f5480c7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:42.372232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8b67a050-b037-45e3-b12a-752e180cc30c None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:42.373439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8b67a050-b037-45e3-b12a-752e180cc30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:42.381783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 128/252] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:42 2022] GET /identity/v3/role_assignments?user.id=11ff5eb80cc04047ab4517bac064be34&scope.project.id=afcb05e9da4b4207af59800fe02b4346&role.id=0d4ee04c69134c1b81f17125e1b1c78d => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:42.383480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed64738-0096-4e12-bac8-84fb5f5480c7 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:42.451375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:42.515732 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed64738-0096-4e12-bac8-84fb5f5480c7 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:42.534760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 125/253] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:42.562682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fb58f-fd69-4603-b394-a55a16ddf84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:42.564090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fb58f-fd69-4603-b394-a55a16ddf84b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.564590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fb58f-fd69-4603-b394-a55a16ddf84b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.565077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fb58f-fd69-4603-b394-a55a16ddf84b None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.566486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fb58f-fd69-4603-b394-a55a16ddf84b None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:42.568615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fb58f-fd69-4603-b394-a55a16ddf84b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:42.570521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 129/254] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:42 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:42.576579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67a050-b037-45e3-b12a-752e180cc30c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:42.586821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fb58f-fd69-4603-b394-a55a16ddf84b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:42.782368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67a050-b037-45e3-b12a-752e180cc30c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:42.804892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:42.817660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fb58f-fd69-4603-b394-a55a16ddf84b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:42.835506 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:42.839410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c7c08-ae2e-464a-a4e6-2e1d652b05d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:42.840096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c7c08-ae2e-464a-a4e6-2e1d652b05d8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.840377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c7c08-ae2e-464a-a4e6-2e1d652b05d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.840652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c7c08-ae2e-464a-a4e6-2e1d652b05d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.863914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c7c08-ae2e-464a-a4e6-2e1d652b05d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-d42c7c08-ae2e-464a-a4e6-2e1d652b05d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:42.869106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:42.869968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:42.870755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:42.870755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:42.870755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:42.870755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:42.870755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:42.870755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:42.870755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:42.870755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:42.870755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:42.870755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:42.870755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:42.870755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:42.870755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 126/255] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:24:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:42.873228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646965a5-cf0e-4d4f-a34b-5447e802a948 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.876685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423530e9-9be5-49ba-92fe-abfc039aee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:42.877360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423530e9-9be5-49ba-92fe-abfc039aee05 None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.877647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423530e9-9be5-49ba-92fe-abfc039aee05 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.877924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423530e9-9be5-49ba-92fe-abfc039aee05 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346/users/3d9b576fea594f2d9363ff739204d91d/roles/59d226afaffe45f597d70faf647f2f22` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.878720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646965a5-cf0e-4d4f-a34b-5447e802a948 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.879009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646965a5-cf0e-4d4f-a34b-5447e802a948 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:42.880900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 127/256] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:42.886157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423530e9-9be5-49ba-92fe-abfc039aee05 None admin] RBAC: Authorizing `identity:create_grant(project_id=afcb05e9da4b4207af59800fe02b4346, user_id=3d9b576fea594f2d9363ff739204d91d, role_id=59d226afaffe45f597d70faf647f2f22)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:42.887601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423530e9-9be5-49ba-92fe-abfc039aee05 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:42.890629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646965a5-cf0e-4d4f-a34b-5447e802a948 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:42.986330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 130/257] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:24:42 2022] PUT /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346/users/3d9b576fea594f2d9363ff739204d91d/roles/59d226afaffe45f597d70faf647f2f22 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:24:42.987765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d07008-7441-4eb9-8c02-fbe3dd05435b None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:42.988070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d07008-7441-4eb9-8c02-fbe3dd05435b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:42.988409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d07008-7441-4eb9-8c02-fbe3dd05435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:43.014494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-56d07008-7441-4eb9-8c02-fbe3dd05435b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:43.015720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-56d07008-7441-4eb9-8c02-fbe3dd05435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:43.033558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646965a5-cf0e-4d4f-a34b-5447e802a948 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:43.097343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 131/258] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:43.122634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed924f-9ffc-419e-ae24-b278e09f1e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:43.123288 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed924f-9ffc-419e-ae24-b278e09f1e67 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:43.123583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed924f-9ffc-419e-ae24-b278e09f1e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:43.123881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed924f-9ffc-419e-ae24-b278e09f1e67 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:43.124652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed924f-9ffc-419e-ae24-b278e09f1e67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:43.124961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed924f-9ffc-419e-ae24-b278e09f1e67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:43.125655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d07008-7441-4eb9-8c02-fbe3dd05435b None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:43.126386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed924f-9ffc-419e-ae24-b278e09f1e67 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:43.139788 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 128/259] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:43.145291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed924f-9ffc-419e-ae24-b278e09f1e67 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:43.253966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:43.324983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed924f-9ffc-419e-ae24-b278e09f1e67 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:43.350970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d07008-7441-4eb9-8c02-fbe3dd05435b None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:43.352771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:43.360703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a318316-6b5b-43e5-947f-505439223c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:43.361356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a318316-6b5b-43e5-947f-505439223c04 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:43.361645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a318316-6b5b-43e5-947f-505439223c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:43.361922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a318316-6b5b-43e5-947f-505439223c04 None admin] PATH_INFO: `/v3/users/c2e87de385bd4e81b186a355a8046131` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:43.366936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a318316-6b5b-43e5-947f-505439223c04 None admin] RBAC: Authorizing `identity:get_user(user_id=c2e87de385bd4e81b186a355a8046131)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:43.368498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a318316-6b5b-43e5-947f-505439223c04 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:43.371935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 129/260] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:43 2022] GET /identity/v3/users/c2e87de385bd4e81b186a355a8046131 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:43.377110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a318316-6b5b-43e5-947f-505439223c04 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:43.429177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495618b1-6b1e-418f-b7ca-cf0ece31091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:43.429839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495618b1-6b1e-418f-b7ca-cf0ece31091f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:43.430125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495618b1-6b1e-418f-b7ca-cf0ece31091f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:43.430400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495618b1-6b1e-418f-b7ca-cf0ece31091f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:43.448747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495618b1-6b1e-418f-b7ca-cf0ece31091f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-495618b1-6b1e-418f-b7ca-cf0ece31091f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:43.461993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:43.462908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:43.468517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:43.468517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:43.468517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:43.468517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:43.468517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:43.468517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:43.468517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:43.468517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:43.468517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:43.468517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:43.468517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:43.468517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:43.468517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 132/261] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:24:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:43.485543 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495618b1-6b1e-418f-b7ca-cf0ece31091f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:43.510184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a318316-6b5b-43e5-947f-505439223c04 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:43.520379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:43.553870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126817e1-3191-4d80-acc5-184af1488bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:43.554620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126817e1-3191-4d80-acc5-184af1488bfd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:43.555003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126817e1-3191-4d80-acc5-184af1488bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:43.555377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126817e1-3191-4d80-acc5-184af1488bfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:43.670592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495618b1-6b1e-418f-b7ca-cf0ece31091f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:43.709942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126817e1-3191-4d80-acc5-184af1488bfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:43.711704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126817e1-3191-4d80-acc5-184af1488bfd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:43.742205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52347813-dd41-4d07-8cd9-f3e8655f3329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:43.743127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52347813-dd41-4d07-8cd9-f3e8655f3329 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:43.744084 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52347813-dd41-4d07-8cd9-f3e8655f3329 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:43.744558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52347813-dd41-4d07-8cd9-f3e8655f3329 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:43.745678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52347813-dd41-4d07-8cd9-f3e8655f3329 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:43.746252 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52347813-dd41-4d07-8cd9-f3e8655f3329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:43.748060 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52347813-dd41-4d07-8cd9-f3e8655f3329 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:43.764466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 133/262] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:24:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:43.773832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52347813-dd41-4d07-8cd9-f3e8655f3329 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:43.825816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:43.921522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 130/263] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:43.927979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126817e1-3191-4d80-acc5-184af1488bfd None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:43.938273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:43.990350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52347813-dd41-4d07-8cd9-f3e8655f3329 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:44.047115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126817e1-3191-4d80-acc5-184af1488bfd None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:44.071383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba19400-ebf3-4a11-b858-be3bdbc32beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:44.072105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba19400-ebf3-4a11-b858-be3bdbc32beb None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.072391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba19400-ebf3-4a11-b858-be3bdbc32beb None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.072672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba19400-ebf3-4a11-b858-be3bdbc32beb None admin] PATH_INFO: `/v3/users/c2e87de385bd4e81b186a355a8046131` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.074449 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba19400-ebf3-4a11-b858-be3bdbc32beb None admin] RBAC: Authorizing `identity:get_user(user_id=c2e87de385bd4e81b186a355a8046131)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:44.075475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba19400-ebf3-4a11-b858-be3bdbc32beb None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:44.081374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 134/264] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:43 2022] GET /identity/v3/users/c2e87de385bd4e81b186a355a8046131 => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:44.087442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba19400-ebf3-4a11-b858-be3bdbc32beb None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:44.097016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba5b56-813c-4017-9667-1c883a9572af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:44.097954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba5b56-813c-4017-9667-1c883a9572af None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.099341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba5b56-813c-4017-9667-1c883a9572af None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.099828 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba5b56-813c-4017-9667-1c883a9572af None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.101205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba5b56-813c-4017-9667-1c883a9572af None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:44.104710 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba5b56-813c-4017-9667-1c883a9572af None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:44.107117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 131/265] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:43 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:44.116901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba5b56-813c-4017-9667-1c883a9572af None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:44.288582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:44.298716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba19400-ebf3-4a11-b858-be3bdbc32beb None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:44.344090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:44.351982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0eae4e-9d2c-4da9-85a1-6899695256e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:44.352614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eae4e-9d2c-4da9-85a1-6899695256e0 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.352895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eae4e-9d2c-4da9-85a1-6899695256e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.353169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eae4e-9d2c-4da9-85a1-6899695256e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.375898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba5b56-813c-4017-9667-1c883a9572af None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:44.415692 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32087e8-b221-4ce7-aedc-baabe596da73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:44.417374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32087e8-b221-4ce7-aedc-baabe596da73 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.417690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32087e8-b221-4ce7-aedc-baabe596da73 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.418120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32087e8-b221-4ce7-aedc-baabe596da73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.418817 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32087e8-b221-4ce7-aedc-baabe596da73 None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=afcb05e9da4b4207af59800fe02b4346, user.id=c2e87de385bd4e81b186a355a8046131) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:44.419255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32087e8-b221-4ce7-aedc-baabe596da73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:44.420709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32087e8-b221-4ce7-aedc-baabe596da73 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:44.428314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 132/266] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:44 2022] GET /identity/v3/role_assignments?user.id=c2e87de385bd4e81b186a355a8046131&scope.project.id=afcb05e9da4b4207af59800fe02b4346&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 608 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:44.429668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c91a-9722-4f59-a0c9-59df3e935747 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.430010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c91a-9722-4f59-a0c9-59df3e935747 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.430292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c91a-9722-4f59-a0c9-59df3e935747 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.431824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 133/267] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:44.433153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239763a-d947-4a4a-a8c6-00c86689fd3e None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.433375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239763a-d947-4a4a-a8c6-00c86689fd3e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.433650 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239763a-d947-4a4a-a8c6-00c86689fd3e None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.439619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 134/268] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:44.440995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54348300-399f-4f17-a8e4-737e3a9d73b1 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.441303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54348300-399f-4f17-a8e4-737e3a9d73b1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.441583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54348300-399f-4f17-a8e4-737e3a9d73b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.453191 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0eae4e-9d2c-4da9-85a1-6899695256e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:44.455011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0eae4e-9d2c-4da9-85a1-6899695256e0 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:44.461334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-54348300-399f-4f17-a8e4-737e3a9d73b1 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:44.462624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-54348300-399f-4f17-a8e4-737e3a9d73b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:44.548827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 135/269] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:44.548827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5370f-2d13-464b-acad-8f66c92afd64 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.548827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5370f-2d13-464b-acad-8f66c92afd64 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.548827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5370f-2d13-464b-acad-8f66c92afd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.570706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a8d5370f-2d13-464b-acad-8f66c92afd64 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:44.572694 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a8d5370f-2d13-464b-acad-8f66c92afd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:44.585631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:44.598696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 135/270] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:24:44.600145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0eae4e-9d2c-4da9-85a1-6899695256e0 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:44.677406 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:44.679895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 136/271] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:44.680910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5370f-2d13-464b-acad-8f66c92afd64 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:44.750879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0eae4e-9d2c-4da9-85a1-6899695256e0 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:44.795358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddd9e8-44e2-4a46-8260-d6af49e2f1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:44.796427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddd9e8-44e2-4a46-8260-d6af49e2f1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.796909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddd9e8-44e2-4a46-8260-d6af49e2f1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.797390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddd9e8-44e2-4a46-8260-d6af49e2f1c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.798757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddd9e8-44e2-4a46-8260-d6af49e2f1c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:44.800501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddd9e8-44e2-4a46-8260-d6af49e2f1c7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:44.803181 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 136/272] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:44.804191 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddd9e8-44e2-4a46-8260-d6af49e2f1c7 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:44.824290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5370f-2d13-464b-acad-8f66c92afd64 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:44.872611 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5b59d-fb8f-4f41-a004-d00c37f82f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:44.873269 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5b59d-fb8f-4f41-a004-d00c37f82f55 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.873552 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5b59d-fb8f-4f41-a004-d00c37f82f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.873825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5b59d-fb8f-4f41-a004-d00c37f82f55 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.875560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5b59d-fb8f-4f41-a004-d00c37f82f55 None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:44.877418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5b59d-fb8f-4f41-a004-d00c37f82f55 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:44.879397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:44.881844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 137/273] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:44 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:44.883104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5b59d-fb8f-4f41-a004-d00c37f82f55 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:44.927401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddd9e8-44e2-4a46-8260-d6af49e2f1c7 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:44.968238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce0495-c47d-40c3-b521-7bb99f11d0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:44.969364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce0495-c47d-40c3-b521-7bb99f11d0df None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:44.969851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce0495-c47d-40c3-b521-7bb99f11d0df None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:44.970375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce0495-c47d-40c3-b521-7bb99f11d0df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:44.984450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce0495-c47d-40c3-b521-7bb99f11d0df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:44.988269 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-c6ce0495-c47d-40c3-b521-7bb99f11d0df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:44.991407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:44.992327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:44.993133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:44.993133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:44.993133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:44.993133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:44.993133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:44.993133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:44.993133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:44.993133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:44.993133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:44.993133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:44.993133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:44.993133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:44.995897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 137/274] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:44.996910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce0495-c47d-40c3-b521-7bb99f11d0df None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:45.021203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5b59d-fb8f-4f41-a004-d00c37f82f55 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:45.072201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb673351-cbbb-4e9b-b795-8741596c8540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:45.072761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673351-cbbb-4e9b-b795-8741596c8540 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:45.073044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673351-cbbb-4e9b-b795-8741596c8540 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:45.073316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673351-cbbb-4e9b-b795-8741596c8540 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:45.074462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb673351-cbbb-4e9b-b795-8741596c8540 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:45.076532 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb673351-cbbb-4e9b-b795-8741596c8540 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:45.126813 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce0495-c47d-40c3-b521-7bb99f11d0df None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:45.149526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:45.163783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52ba07-83dd-45d1-83ba-01e0476b10d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:45.164414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ba07-83dd-45d1-83ba-01e0476b10d1 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:45.164699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ba07-83dd-45d1-83ba-01e0476b10d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:45.164978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ba07-83dd-45d1-83ba-01e0476b10d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:45.165776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52ba07-83dd-45d1-83ba-01e0476b10d1 None admin] RBAC: Adding query filter params (role.id=8595eaa9629b4ec4a628d662402fd25d, scope.project.id=afcb05e9da4b4207af59800fe02b4346, user.id=c2e87de385bd4e81b186a355a8046131) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:45.166089 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52ba07-83dd-45d1-83ba-01e0476b10d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:45.167591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52ba07-83dd-45d1-83ba-01e0476b10d1 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:45.178984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 138/275] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:44 2022] GET /identity/v3/role_assignments?user.id=c2e87de385bd4e81b186a355a8046131&scope.project.id=afcb05e9da4b4207af59800fe02b4346&role.id=8595eaa9629b4ec4a628d662402fd25d => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:45.178984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52ba07-83dd-45d1-83ba-01e0476b10d1 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:45.221860 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 138/276] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:24:44 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:24:45.324531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c097e94-bd3a-4e52-80a4-5c3a1db6db28 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:45.324841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c097e94-bd3a-4e52-80a4-5c3a1db6db28 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:45.325052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c097e94-bd3a-4e52-80a4-5c3a1db6db28 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:45.326369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 139/277] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:24:45.333326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52ba07-83dd-45d1-83ba-01e0476b10d1 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:45.341469 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3cc5-ac97-4437-b16b-ef5be4bd4332 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:45.341857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3cc5-ac97-4437-b16b-ef5be4bd4332 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:45.342013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b3cc5-ac97-4437-b16b-ef5be4bd4332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:45.386174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-1c7b3cc5-ac97-4437-b16b-ef5be4bd4332 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:45.388397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40577ce4-406f-486e-8271-482696bdd4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:45.389044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40577ce4-406f-486e-8271-482696bdd4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:45.389327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40577ce4-406f-486e-8271-482696bdd4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:45.389603 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40577ce4-406f-486e-8271-482696bdd4b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:45.390035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1c7b3cc5-ac97-4437-b16b-ef5be4bd4332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:45.390346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40577ce4-406f-486e-8271-482696bdd4b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:45.390708 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40577ce4-406f-486e-8271-482696bdd4b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:45.393298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40577ce4-406f-486e-8271-482696bdd4b7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:45.405877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 139/278] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:45.413071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40577ce4-406f-486e-8271-482696bdd4b7 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:45.470986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:45.479180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 140/279] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:24:45.503229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b3cc5-ac97-4437-b16b-ef5be4bd4332 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:45.545179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40577ce4-406f-486e-8271-482696bdd4b7 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:45.587942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:45.593935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7a470-5721-4bbe-bcf2-23a73ff98cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:45.594593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7a470-5721-4bbe-bcf2-23a73ff98cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:45.595037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7a470-5721-4bbe-bcf2-23a73ff98cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:45.595322 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7a470-5721-4bbe-bcf2-23a73ff98cf3 None admin] PATH_INFO: `/v3/users/bdcf1584b512475f9ea5253d38432f19` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:45.614732 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7a470-5721-4bbe-bcf2-23a73ff98cf3 None admin] RBAC: Authorizing `identity:get_user(user_id=bdcf1584b512475f9ea5253d38432f19)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:45.617138 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7a470-5721-4bbe-bcf2-23a73ff98cf3 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:45.618152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 140/280] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:45 2022] GET /identity/v3/users/bdcf1584b512475f9ea5253d38432f19 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:45.625176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7a470-5721-4bbe-bcf2-23a73ff98cf3 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:45.645784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b3cc5-ac97-4437-b16b-ef5be4bd4332 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:45.692616 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed00f4-7cd8-4390-b563-2cb5d3f7b48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:45.693577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed00f4-7cd8-4390-b563-2cb5d3f7b48b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:45.693870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed00f4-7cd8-4390-b563-2cb5d3f7b48b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:45.694151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed00f4-7cd8-4390-b563-2cb5d3f7b48b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:45.705861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed00f4-7cd8-4390-b563-2cb5d3f7b48b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-12ed00f4-7cd8-4390-b563-2cb5d3f7b48b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:45.712178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:45.713051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:45.714267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:45.714267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:45.714267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:45.714267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:45.714267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:45.714267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:45.714267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:45.714267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:45.714267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:45.714267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:45.714267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:45.714267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:45.714267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 141/281] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:45.719318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed00f4-7cd8-4390-b563-2cb5d3f7b48b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:45.771415 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7a470-5721-4bbe-bcf2-23a73ff98cf3 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:45.774477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:45.818954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b5d1-1889-4d73-9c64-ed3a2992f2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:45.819584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b5d1-1889-4d73-9c64-ed3a2992f2db None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:45.819900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b5d1-1889-4d73-9c64-ed3a2992f2db None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:45.820183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b5d1-1889-4d73-9c64-ed3a2992f2db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:45.821369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802b5d1-1889-4d73-9c64-ed3a2992f2db None admin] RBAC: Adding query filter params (role.id=59d226afaffe45f597d70faf647f2f22, user.id=bdcf1584b512475f9ea5253d38432f19, scope.system=all) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:45.821694 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802b5d1-1889-4d73-9c64-ed3a2992f2db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:45.823193 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802b5d1-1889-4d73-9c64-ed3a2992f2db None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:45.832190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 141/282] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Jul 25 21:24:45 2022] GET /identity/v3/role_assignments?user.id=bdcf1584b512475f9ea5253d38432f19&scope.system=all&role.id=59d226afaffe45f597d70faf647f2f22 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:45.853907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed00f4-7cd8-4390-b563-2cb5d3f7b48b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:45.870146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:45.893214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb951c5f-de56-4e83-a853-0cd0dff1daa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:45.893852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb951c5f-de56-4e83-a853-0cd0dff1daa5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:45.894135 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb951c5f-de56-4e83-a853-0cd0dff1daa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:45.894411 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb951c5f-de56-4e83-a853-0cd0dff1daa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:45.895837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb951c5f-de56-4e83-a853-0cd0dff1daa5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:45.896297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb951c5f-de56-4e83-a853-0cd0dff1daa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:45.897742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb951c5f-de56-4e83-a853-0cd0dff1daa5 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:45.907310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 142/283] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:45.916022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b5d1-1889-4d73-9c64-ed3a2992f2db None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:46.034886 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b5d1-1889-4d73-9c64-ed3a2992f2db None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:46.076210 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a347e-7ee5-4e68-a38a-a0f78ed99e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:46.076896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a347e-7ee5-4e68-a38a-a0f78ed99e5d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:46.077181 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a347e-7ee5-4e68-a38a-a0f78ed99e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:46.077506 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a347e-7ee5-4e68-a38a-a0f78ed99e5d None admin] PATH_INFO: `/v3/users/11ff5eb80cc04047ab4517bac064be34` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:46.078711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a347e-7ee5-4e68-a38a-a0f78ed99e5d None admin] RBAC: Authorizing `identity:get_user(user_id=11ff5eb80cc04047ab4517bac064be34)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:46.080187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a347e-7ee5-4e68-a38a-a0f78ed99e5d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:46.082013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 142/284] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:45 2022] GET /identity/v3/users/11ff5eb80cc04047ab4517bac064be34 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:46.087993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb951c5f-de56-4e83-a853-0cd0dff1daa5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:46.089906 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf19005-faae-4cd7-ab13-45240614a2ae None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:46.090203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf19005-faae-4cd7-ab13-45240614a2ae None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:46.090485 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf19005-faae-4cd7-ab13-45240614a2ae None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:46.091863 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 143/285] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:24:46.096994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dccad1-d697-4902-892a-07f8b459222b None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:46.097281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dccad1-d697-4902-892a-07f8b459222b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:46.097557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dccad1-d697-4902-892a-07f8b459222b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:46.119161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-19dccad1-d697-4902-892a-07f8b459222b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:46.120328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-19dccad1-d697-4902-892a-07f8b459222b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:46.156738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:46.230893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb951c5f-de56-4e83-a853-0cd0dff1daa5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:46.265406 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 144/286] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:46.283256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c994fa7-b1ae-4247-b0a1-dc02ae22c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:46.283941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c994fa7-b1ae-4247-b0a1-dc02ae22c348 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:46.284229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c994fa7-b1ae-4247-b0a1-dc02ae22c348 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:46.284508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c994fa7-b1ae-4247-b0a1-dc02ae22c348 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:46.288468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c994fa7-b1ae-4247-b0a1-dc02ae22c348 None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:46.289945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c994fa7-b1ae-4247-b0a1-dc02ae22c348 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:46.291910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 143/287] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:46 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:46.297547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dccad1-d697-4902-892a-07f8b459222b None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:46.304101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c994fa7-b1ae-4247-b0a1-dc02ae22c348 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:46.360824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:46.431062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c994fa7-b1ae-4247-b0a1-dc02ae22c348 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:46.481458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f523d-ac4b-4f98-8c76-f4b869d0906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:46.482453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f523d-ac4b-4f98-8c76-f4b869d0906b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:46.483094 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f523d-ac4b-4f98-8c76-f4b869d0906b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:46.484632 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f523d-ac4b-4f98-8c76-f4b869d0906b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:46.501900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f523d-ac4b-4f98-8c76-f4b869d0906b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:46.504050 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dccad1-d697-4902-892a-07f8b459222b None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-c53f523d-ac4b-4f98-8c76-f4b869d0906b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:46.513393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:46.514278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:46.515462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:46.515462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:46.515462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:46.515462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:46.515462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:46.515462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:46.515462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:46.515462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:46.515462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:46.515462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:46.515462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:46.515462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:46.515462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 144/288] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:46.520299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f523d-ac4b-4f98-8c76-f4b869d0906b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:46.544737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b055a0-d74f-450c-9bc7-8eef35bdde10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:46.545737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b055a0-d74f-450c-9bc7-8eef35bdde10 None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:46.546180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b055a0-d74f-450c-9bc7-8eef35bdde10 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:46.546613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b055a0-d74f-450c-9bc7-8eef35bdde10 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346/users/11ff5eb80cc04047ab4517bac064be34/roles/0d4ee04c69134c1b81f17125e1b1c78d` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:46.548853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b055a0-d74f-450c-9bc7-8eef35bdde10 None admin] RBAC: Authorizing `identity:create_grant(project_id=afcb05e9da4b4207af59800fe02b4346, user_id=11ff5eb80cc04047ab4517bac064be34, role_id=0d4ee04c69134c1b81f17125e1b1c78d)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:46.551625 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b055a0-d74f-450c-9bc7-8eef35bdde10 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:46.643085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 145/289] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:24:46 2022] PUT /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346/users/11ff5eb80cc04047ab4517bac064be34/roles/0d4ee04c69134c1b81f17125e1b1c78d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:24:46.652239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f523d-ac4b-4f98-8c76-f4b869d0906b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:46.663772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:46.713960 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41c718-2ae0-4e2f-a2ca-085dab370d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:46.714609 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41c718-2ae0-4e2f-a2ca-085dab370d95 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:46.714893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41c718-2ae0-4e2f-a2ca-085dab370d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:46.715168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41c718-2ae0-4e2f-a2ca-085dab370d95 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:46.715942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41c718-2ae0-4e2f-a2ca-085dab370d95 None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:46.716251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41c718-2ae0-4e2f-a2ca-085dab370d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:46.717698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41c718-2ae0-4e2f-a2ca-085dab370d95 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:46.732499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 145/290] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:46.737963 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b055a0-d74f-450c-9bc7-8eef35bdde10 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:46.778126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:46.870858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b055a0-d74f-450c-9bc7-8eef35bdde10 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:46.917221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25587601-b649-41ef-996a-1a0223a43324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:46.917885 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25587601-b649-41ef-996a-1a0223a43324 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:46.918172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25587601-b649-41ef-996a-1a0223a43324 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:46.918450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25587601-b649-41ef-996a-1a0223a43324 None admin] PATH_INFO: `/v3/users/3d9b576fea594f2d9363ff739204d91d` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:46.919639 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25587601-b649-41ef-996a-1a0223a43324 None admin] RBAC: Authorizing `identity:get_user(user_id=3d9b576fea594f2d9363ff739204d91d)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:46.921187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25587601-b649-41ef-996a-1a0223a43324 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:46.923135 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 146/291] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:46 2022] GET /identity/v3/users/3d9b576fea594f2d9363ff739204d91d => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:46.928940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41c718-2ae0-4e2f-a2ca-085dab370d95 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:47.048363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41c718-2ae0-4e2f-a2ca-085dab370d95 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:47.094812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e451b9-dfbc-406b-9ef5-278d8a9162e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:47.095438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e451b9-dfbc-406b-9ef5-278d8a9162e3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:47.095716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e451b9-dfbc-406b-9ef5-278d8a9162e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:47.096013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e451b9-dfbc-406b-9ef5-278d8a9162e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:47.148508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:47.201830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e451b9-dfbc-406b-9ef5-278d8a9162e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:47.203306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e451b9-dfbc-406b-9ef5-278d8a9162e3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:47.323280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 146/292] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:47.328387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25587601-b649-41ef-996a-1a0223a43324 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:47.461225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:47.468338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25587601-b649-41ef-996a-1a0223a43324 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:47.509082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fd8a9-45e2-45af-96bb-1da5ed925984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:47.509741 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fd8a9-45e2-45af-96bb-1da5ed925984 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:47.510023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fd8a9-45e2-45af-96bb-1da5ed925984 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:47.510303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fd8a9-45e2-45af-96bb-1da5ed925984 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:47.511607 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fd8a9-45e2-45af-96bb-1da5ed925984 None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:47.513098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fd8a9-45e2-45af-96bb-1da5ed925984 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:47.514967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 147/293] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:47 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:47.521289 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e451b9-dfbc-406b-9ef5-278d8a9162e3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:47.600488 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:47.638909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e451b9-dfbc-406b-9ef5-278d8a9162e3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:47.686308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12411a9-35d4-423c-a7a4-de9c2ca2157e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:47.686938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12411a9-35d4-423c-a7a4-de9c2ca2157e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:47.687220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12411a9-35d4-423c-a7a4-de9c2ca2157e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:47.687494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12411a9-35d4-423c-a7a4-de9c2ca2157e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:47.688331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12411a9-35d4-423c-a7a4-de9c2ca2157e None admin] RBAC: Adding query filter params (role.id=59d226afaffe45f597d70faf647f2f22, scope.project.id=afcb05e9da4b4207af59800fe02b4346, user.id=3d9b576fea594f2d9363ff739204d91d) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:47.688636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12411a9-35d4-423c-a7a4-de9c2ca2157e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:47.691625 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12411a9-35d4-423c-a7a4-de9c2ca2157e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:47.700580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 147/294] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:47 2022] GET /identity/v3/role_assignments?user.id=3d9b576fea594f2d9363ff739204d91d&scope.project.id=afcb05e9da4b4207af59800fe02b4346&role.id=59d226afaffe45f597d70faf647f2f22 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:48.116613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa080750-708d-4cfa-916f-9d8f8fba6e77 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:48.117156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa080750-708d-4cfa-916f-9d8f8fba6e77 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:48.117156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa080750-708d-4cfa-916f-9d8f8fba6e77 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:48.118910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 148/295] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:48.124202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4efed-690a-4bbd-9e9a-e6b986a9785a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:48.124628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4efed-690a-4bbd-9e9a-e6b986a9785a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:48.124735 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4efed-690a-4bbd-9e9a-e6b986a9785a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:48.147598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-aff4efed-690a-4bbd-9e9a-e6b986a9785a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:48.151364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-aff4efed-690a-4bbd-9e9a-e6b986a9785a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:48.161070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59660958-736b-46db-ab86-0ea6fdd8aea3 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:48.161070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59660958-736b-46db-ab86-0ea6fdd8aea3 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:48.161070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59660958-736b-46db-ab86-0ea6fdd8aea3 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:48.161070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 149/296] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:48.173562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c97299-b894-400d-9341-bb0ddf6b6067 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:48.173852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c97299-b894-400d-9341-bb0ddf6b6067 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:48.174130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c97299-b894-400d-9341-bb0ddf6b6067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:48.196434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-b6c97299-b894-400d-9341-bb0ddf6b6067 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:48.197760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-b6c97299-b894-400d-9341-bb0ddf6b6067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:48.241628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 148/297] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:48.268757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4efed-690a-4bbd-9e9a-e6b986a9785a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:48.289868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 150/298] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:24:48.312108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c97299-b894-400d-9341-bb0ddf6b6067 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:48.360877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:48.377564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4efed-690a-4bbd-9e9a-e6b986a9785a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:48.409840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:48.414838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c333f-a7f7-448d-b607-d6d7ada38faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:48.415483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c333f-a7f7-448d-b607-d6d7ada38faa None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:48.415788 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c333f-a7f7-448d-b607-d6d7ada38faa None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:48.416067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c333f-a7f7-448d-b607-d6d7ada38faa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:48.419767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c97299-b894-400d-9341-bb0ddf6b6067 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:48.426590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c333f-a7f7-448d-b607-d6d7ada38faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-0f6c333f-a7f7-448d-b607-d6d7ada38faa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:48.431537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:48.432447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:48.438087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:48.438087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:48.438087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:48.438087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:48.438087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:48.438087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:48.438087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:48.438087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:48.438087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:48.438087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:48.438087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:48.438087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:48.438087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 149/299] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:24:48.438087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a901c4-1c6e-44e6-8572-33c7736ab3fe None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:48.438784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a901c4-1c6e-44e6-8572-33c7736ab3fe None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:48.438784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a901c4-1c6e-44e6-8572-33c7736ab3fe None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:48.438784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 150/300] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:48.440513 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a901c4-1c6e-44e6-8572-33c7736ab3fe None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:48.462588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a28d18-708b-4d9c-b5b0-4cb2532f27a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:48.463227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a28d18-708b-4d9c-b5b0-4cb2532f27a9 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:48.463514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a28d18-708b-4d9c-b5b0-4cb2532f27a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:48.463816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a28d18-708b-4d9c-b5b0-4cb2532f27a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:48.476937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a28d18-708b-4d9c-b5b0-4cb2532f27a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-c6a28d18-708b-4d9c-b5b0-4cb2532f27a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:48.481956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:48.482842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:48.483618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:48.483618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:48.483618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:48.483618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:48.483618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:48.483618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:48.483618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:48.483618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:48.483618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:48.483618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:48.483618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:48.483618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:48.483618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 151/301] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:24:48.484326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848cf0c-1c94-4fd4-844e-4473bbf42cd4 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:48.484727 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848cf0c-1c94-4fd4-844e-4473bbf42cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:48.484824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848cf0c-1c94-4fd4-844e-4473bbf42cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:48.502754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-5848cf0c-1c94-4fd4-844e-4473bbf42cd4 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:48.503969 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-5848cf0c-1c94-4fd4-844e-4473bbf42cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:48.556190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a901c4-1c6e-44e6-8572-33c7736ab3fe None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:48.576994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 152/302] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:48.578355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848cf0c-1c94-4fd4-844e-4473bbf42cd4 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:48.580362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:48.605307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de71163-c740-46f0-9951-9a1a675ee0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:48.605933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de71163-c740-46f0-9951-9a1a675ee0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:48.606218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de71163-c740-46f0-9951-9a1a675ee0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:48.606486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de71163-c740-46f0-9951-9a1a675ee0d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:48.607228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de71163-c740-46f0-9951-9a1a675ee0d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:48.607523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de71163-c740-46f0-9951-9a1a675ee0d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:48.609111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de71163-c740-46f0-9951-9a1a675ee0d0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:48.623006 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 151/303] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:48.623006 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de71163-c740-46f0-9951-9a1a675ee0d0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:48.677623 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:48.700788 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848cf0c-1c94-4fd4-844e-4473bbf42cd4 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:48.737541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de71163-c740-46f0-9951-9a1a675ee0d0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:48.737836 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29709fb9-6ab1-42e2-8943-c6383d10d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:48.738263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29709fb9-6ab1-42e2-8943-c6383d10d859 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:48.738731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29709fb9-6ab1-42e2-8943-c6383d10d859 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:48.739007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29709fb9-6ab1-42e2-8943-c6383d10d859 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:48.739841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29709fb9-6ab1-42e2-8943-c6383d10d859 None admin] RBAC: Adding query filter params (name=member) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:48.740146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29709fb9-6ab1-42e2-8943-c6383d10d859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:48.741516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29709fb9-6ab1-42e2-8943-c6383d10d859 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:48.750085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 153/304] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:48.755345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29709fb9-6ab1-42e2-8943-c6383d10d859 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:48.774581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87261b-26fb-4b26-8bc8-aad26907a038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:48.775239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87261b-26fb-4b26-8bc8-aad26907a038 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:48.775522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87261b-26fb-4b26-8bc8-aad26907a038 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:48.775826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87261b-26fb-4b26-8bc8-aad26907a038 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:48.777162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87261b-26fb-4b26-8bc8-aad26907a038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:48.778622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87261b-26fb-4b26-8bc8-aad26907a038 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:48.780604 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 152/305] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:48.786377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87261b-26fb-4b26-8bc8-aad26907a038 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:48.838282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:48.861732 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29709fb9-6ab1-42e2-8943-c6383d10d859 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:48.890874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87261b-26fb-4b26-8bc8-aad26907a038 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:48.900118 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb40af6-f5b1-4b4e-8f56-07792c00d1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:48.900767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40af6-f5b1-4b4e-8f56-07792c00d1ce None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:48.901046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40af6-f5b1-4b4e-8f56-07792c00d1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:48.901318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40af6-f5b1-4b4e-8f56-07792c00d1ce None admin] PATH_INFO: `/v3/users/1c75ad943261491fa9e4d4a548907dde` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:48.915467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb40af6-f5b1-4b4e-8f56-07792c00d1ce None admin] RBAC: Authorizing `identity:get_user(user_id=1c75ad943261491fa9e4d4a548907dde)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:48.916943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb40af6-f5b1-4b4e-8f56-07792c00d1ce None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:48.918624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 154/306] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:48 2022] GET /identity/v3/users/1c75ad943261491fa9e4d4a548907dde => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:48.919364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb40af6-f5b1-4b4e-8f56-07792c00d1ce None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:48.921849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:48.934940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9a662-ee3c-42fb-ad38-15bbba235197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:48.935642 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a662-ee3c-42fb-ad38-15bbba235197 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:48.936106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a662-ee3c-42fb-ad38-15bbba235197 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:48.936386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9a662-ee3c-42fb-ad38-15bbba235197 None admin] PATH_INFO: `/v3/users/bdcf1584b512475f9ea5253d38432f19` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:48.937579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9a662-ee3c-42fb-ad38-15bbba235197 None admin] RBAC: Authorizing `identity:get_user(user_id=bdcf1584b512475f9ea5253d38432f19)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:48.939028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9a662-ee3c-42fb-ad38-15bbba235197 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:48.940917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 153/307] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:48 2022] GET /identity/v3/users/bdcf1584b512475f9ea5253d38432f19 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:48.941538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9a662-ee3c-42fb-ad38-15bbba235197 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:49.028855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb40af6-f5b1-4b4e-8f56-07792c00d1ce None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:49.045664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9a662-ee3c-42fb-ad38-15bbba235197 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:49.063827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4872d15-bb06-418c-9501-f4b56eed2751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:49.064039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:49.064202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4872d15-bb06-418c-9501-f4b56eed2751 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:49.064826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4872d15-bb06-418c-9501-f4b56eed2751 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:49.064826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4872d15-bb06-418c-9501-f4b56eed2751 None admin] PATH_INFO: `/v3/groups` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:49.065395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4872d15-bb06-418c-9501-f4b56eed2751 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:49.066868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4872d15-bb06-418c-9501-f4b56eed2751 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:49.082344 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c6174-fb5d-43b6-8ecf-c425bf433570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:49.082981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6174-fb5d-43b6-8ecf-c425bf433570 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:49.083251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6174-fb5d-43b6-8ecf-c425bf433570 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:49.083522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6174-fb5d-43b6-8ecf-c425bf433570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:49.085403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c6174-fb5d-43b6-8ecf-c425bf433570 None admin] RBAC: Adding query filter params (role.id=0d4ee04c69134c1b81f17125e1b1c78d, user.id=1c75ad943261491fa9e4d4a548907dde, scope.system=all) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:49.085403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c6174-fb5d-43b6-8ecf-c425bf433570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:49.086237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c6174-fb5d-43b6-8ecf-c425bf433570 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:49.091168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 154/308] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Jul 25 21:24:48 2022] GET /identity/v3/role_assignments?user.id=1c75ad943261491fa9e4d4a548907dde&scope.system=all&role.id=0d4ee04c69134c1b81f17125e1b1c78d => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:49.091952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c6174-fb5d-43b6-8ecf-c425bf433570 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:49.160264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 155/309] 10.222.0.27 () {60 vars in 1134 bytes} [Mon Jul 25 21:24:48 2022] POST /identity/v3/groups => generated 229 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:24:49.216914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c6174-fb5d-43b6-8ecf-c425bf433570 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:49.237318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af244eb-4353-4826-98ff-7478f8f69929 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:49.237614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af244eb-4353-4826-98ff-7478f8f69929 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:49.237896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af244eb-4353-4826-98ff-7478f8f69929 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:49.239315 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 156/310] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:24:49.247548 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef938f-3e52-423b-94f9-8dbd8667711d None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:49.248762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef938f-3e52-423b-94f9-8dbd8667711d None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:49.249417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef938f-3e52-423b-94f9-8dbd8667711d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:49.262751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8dba8-3bb0-4de3-b605-e90fefe7ac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:49.263446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8dba8-3bb0-4de3-b605-e90fefe7ac15 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:49.263755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8dba8-3bb0-4de3-b605-e90fefe7ac15 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:49.264039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8dba8-3bb0-4de3-b605-e90fefe7ac15 None admin] PATH_INFO: `/v3/system/users/bdcf1584b512475f9ea5253d38432f19/roles/59d226afaffe45f597d70faf647f2f22` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:49.265615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8dba8-3bb0-4de3-b605-e90fefe7ac15 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bdcf1584b512475f9ea5253d38432f19, role_id=59d226afaffe45f597d70faf647f2f22)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:49.267040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8dba8-3bb0-4de3-b605-e90fefe7ac15 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:49.276426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-feef938f-3e52-423b-94f9-8dbd8667711d None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:49.278240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-feef938f-3e52-423b-94f9-8dbd8667711d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:49.349024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:49.360295 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 157/311] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:24:49.381782 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 155/312] 10.222.0.27 () {58 vars in 1334 bytes} [Mon Jul 25 21:24:49 2022] PUT /identity/v3/system/users/bdcf1584b512475f9ea5253d38432f19/roles/59d226afaffe45f597d70faf647f2f22 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:24:49.389019 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef938f-3e52-423b-94f9-8dbd8667711d None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:49.508535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef938f-3e52-423b-94f9-8dbd8667711d None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:49.547598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1cc23-081b-4944-b82e-8eed7f4036ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:49.548297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1cc23-081b-4944-b82e-8eed7f4036ed None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:49.548583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1cc23-081b-4944-b82e-8eed7f4036ed None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:49.556609 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1cc23-081b-4944-b82e-8eed7f4036ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:49.561744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1cc23-081b-4944-b82e-8eed7f4036ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-ecc1cc23-081b-4944-b82e-8eed7f4036ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:49.567476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:49.568425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:49.569194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:49.569194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:49.569194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:49.569194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:49.569194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:49.569194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:49.569194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:49.569194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:49.569194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:49.569194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:49.569194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:49.569194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:49.569194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 158/313] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:49.574761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8dba8-3bb0-4de3-b605-e90fefe7ac15 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:49.629148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:49.699228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8dba8-3bb0-4de3-b605-e90fefe7ac15 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:49.731405 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a806b-a16b-430a-b4c3-cb81d1f842b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:49.732072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a806b-a16b-430a-b4c3-cb81d1f842b5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:49.732360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a806b-a16b-430a-b4c3-cb81d1f842b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:49.732639 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a806b-a16b-430a-b4c3-cb81d1f842b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:49.733375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a806b-a16b-430a-b4c3-cb81d1f842b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:49.733685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a806b-a16b-430a-b4c3-cb81d1f842b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:49.735075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a806b-a16b-430a-b4c3-cb81d1f842b5 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:49.744538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 156/314] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:49.750109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1cc23-081b-4944-b82e-8eed7f4036ed None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:49.808273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:49.858992 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1cc23-081b-4944-b82e-8eed7f4036ed None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:49.895417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79911da8-3bb9-48c6-8785-ceadabe98f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:49.896514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79911da8-3bb9-48c6-8785-ceadabe98f77 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:49.896991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79911da8-3bb9-48c6-8785-ceadabe98f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:49.897457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79911da8-3bb9-48c6-8785-ceadabe98f77 None admin] PATH_INFO: `/v3/users/11ff5eb80cc04047ab4517bac064be34` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:49.900337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79911da8-3bb9-48c6-8785-ceadabe98f77 None admin] RBAC: Authorizing `identity:get_user(user_id=11ff5eb80cc04047ab4517bac064be34)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:49.901994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79911da8-3bb9-48c6-8785-ceadabe98f77 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:49.904105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 159/315] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:49 2022] GET /identity/v3/users/11ff5eb80cc04047ab4517bac064be34 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:49.909273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a806b-a16b-430a-b4c3-cb81d1f842b5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:50.016345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a806b-a16b-430a-b4c3-cb81d1f842b5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:50.025609 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:50.054157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc3996-3a78-4abb-9aac-eeaa47619b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:50.054792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc3996-3a78-4abb-9aac-eeaa47619b02 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:50.055081 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc3996-3a78-4abb-9aac-eeaa47619b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:50.055357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc3996-3a78-4abb-9aac-eeaa47619b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:50.125819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc3996-3a78-4abb-9aac-eeaa47619b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:50.127235 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc3996-3a78-4abb-9aac-eeaa47619b02 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:50.234943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 157/316] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:24:50.240852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79911da8-3bb9-48c6-8785-ceadabe98f77 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:50.374644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79911da8-3bb9-48c6-8785-ceadabe98f77 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:50.396769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:50.412301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5945e-f1ed-42ef-bed3-d9529dee4355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:50.412977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5945e-f1ed-42ef-bed3-d9529dee4355 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:50.418324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5945e-f1ed-42ef-bed3-d9529dee4355 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:50.418324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5945e-f1ed-42ef-bed3-d9529dee4355 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:50.418324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5945e-f1ed-42ef-bed3-d9529dee4355 None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:50.418324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5945e-f1ed-42ef-bed3-d9529dee4355 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:50.418324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 160/317] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:50 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:50.424183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc3996-3a78-4abb-9aac-eeaa47619b02 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:50.436108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:50.533899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc3996-3a78-4abb-9aac-eeaa47619b02 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:50.574681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51aa64-90fd-47ea-b359-6985b9c2d32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:50.575339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51aa64-90fd-47ea-b359-6985b9c2d32e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:50.575634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51aa64-90fd-47ea-b359-6985b9c2d32e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:50.575980 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51aa64-90fd-47ea-b359-6985b9c2d32e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:50.576806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51aa64-90fd-47ea-b359-6985b9c2d32e None admin] RBAC: Adding query filter params (role.id=0d4ee04c69134c1b81f17125e1b1c78d, scope.project.id=afcb05e9da4b4207af59800fe02b4346, user.id=11ff5eb80cc04047ab4517bac064be34) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:50.577121 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51aa64-90fd-47ea-b359-6985b9c2d32e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:50.578653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51aa64-90fd-47ea-b359-6985b9c2d32e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:50.586425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 158/318] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:24:50 2022] GET /identity/v3/role_assignments?user.id=11ff5eb80cc04047ab4517bac064be34&scope.project.id=afcb05e9da4b4207af59800fe02b4346&role.id=0d4ee04c69134c1b81f17125e1b1c78d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:51.176205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63018cf6-e38e-40a7-9209-fd7e88275d9b None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:51.176638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63018cf6-e38e-40a7-9209-fd7e88275d9b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:51.176819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63018cf6-e38e-40a7-9209-fd7e88275d9b None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:51.178166 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 161/319] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:51.183303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f001523-37a3-439f-9a50-d378ae372a26 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:51.183592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f001523-37a3-439f-9a50-d378ae372a26 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:51.183914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f001523-37a3-439f-9a50-d378ae372a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:51.202968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4f001523-37a3-439f-9a50-d378ae372a26 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:51.204201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4f001523-37a3-439f-9a50-d378ae372a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:51.273696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 159/320] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:51.295010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63018cf6-e38e-40a7-9209-fd7e88275d9b None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:51.399463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63018cf6-e38e-40a7-9209-fd7e88275d9b None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:51.433711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded17e64-1f22-4660-ae44-92f7aa767a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:51.433900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a370012-df83-494d-9e6c-a4ba9519e5d3 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:51.434147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a370012-df83-494d-9e6c-a4ba9519e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:51.434311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded17e64-1f22-4660-ae44-92f7aa767a3c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:51.434407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a370012-df83-494d-9e6c-a4ba9519e5d3 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:51.434571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded17e64-1f22-4660-ae44-92f7aa767a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:51.434814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded17e64-1f22-4660-ae44-92f7aa767a3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:51.435945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 160/321] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:24:51.440570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820552f5-bc6f-45c1-b838-e4e3d2e570ca None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:51.440855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820552f5-bc6f-45c1-b838-e4e3d2e570ca None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:51.441131 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820552f5-bc6f-45c1-b838-e4e3d2e570ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:51.446133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded17e64-1f22-4660-ae44-92f7aa767a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:51.448147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-ded17e64-1f22-4660-ae44-92f7aa767a3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:51.451227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:51.452200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:51.453023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:51.453023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:51.453023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:51.453023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:51.453023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:51.453023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:51.453023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:51.453023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:51.453023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:51.453023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:51.453023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:51.453023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:51.457158 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 162/322] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:51.458662 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded17e64-1f22-4660-ae44-92f7aa767a3c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:51.461985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-820552f5-bc6f-45c1-b838-e4e3d2e570ca None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:51.465105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-820552f5-bc6f-45c1-b838-e4e3d2e570ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:51.511377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:51.532826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 161/323] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:24:51.535619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d919e-ddbb-454f-8264-b29984dbc4d0 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:51.535619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d919e-ddbb-454f-8264-b29984dbc4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:51.535619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d919e-ddbb-454f-8264-b29984dbc4d0 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:51.540295 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 162/324] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:51.541911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ccf42-252f-4837-b603-26bca454a688 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:51.542516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ccf42-252f-4837-b603-26bca454a688 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:51.542796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ccf42-252f-4837-b603-26bca454a688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:51.563124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded17e64-1f22-4660-ae44-92f7aa767a3c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:51.563338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-702ccf42-252f-4837-b603-26bca454a688 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:51.564527 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-702ccf42-252f-4837-b603-26bca454a688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:51.628806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dae9ee-6932-4209-9f05-65472f1354ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:51.630195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dae9ee-6932-4209-9f05-65472f1354ca None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:51.630478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dae9ee-6932-4209-9f05-65472f1354ca None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:51.630751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dae9ee-6932-4209-9f05-65472f1354ca None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:51.631473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dae9ee-6932-4209-9f05-65472f1354ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:51.631807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dae9ee-6932-4209-9f05-65472f1354ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:51.633172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dae9ee-6932-4209-9f05-65472f1354ca None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:51.641306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 163/325] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:51.642134 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dae9ee-6932-4209-9f05-65472f1354ca None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:51.662875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 163/326] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:51.663807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ccf42-252f-4837-b603-26bca454a688 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:51.742643 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:51.747491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dae9ee-6932-4209-9f05-65472f1354ca None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:51.757830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:51.780796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4a8e2-ed9e-42b6-81b8-dc3efd1c54b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:51.780965 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ccf42-252f-4837-b603-26bca454a688 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:51.781440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4a8e2-ed9e-42b6-81b8-dc3efd1c54b2 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:51.781722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4a8e2-ed9e-42b6-81b8-dc3efd1c54b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:51.781999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4a8e2-ed9e-42b6-81b8-dc3efd1c54b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:51.783151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4a8e2-ed9e-42b6-81b8-dc3efd1c54b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:51.784629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4a8e2-ed9e-42b6-81b8-dc3efd1c54b2 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:51.787187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 164/327] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:24:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:51.787975 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4a8e2-ed9e-42b6-81b8-dc3efd1c54b2 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:51.819018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb5876-cbce-41f5-a264-6220834aa49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:51.819802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5876-cbce-41f5-a264-6220834aa49e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:51.819990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5876-cbce-41f5-a264-6220834aa49e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:51.820261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb5876-cbce-41f5-a264-6220834aa49e None admin] PATH_INFO: `/v3/users/1c75ad943261491fa9e4d4a548907dde` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:51.821429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb5876-cbce-41f5-a264-6220834aa49e None admin] RBAC: Authorizing `identity:get_user(user_id=1c75ad943261491fa9e4d4a548907dde)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:51.822877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb5876-cbce-41f5-a264-6220834aa49e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:51.824515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 164/328] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:51 2022] GET /identity/v3/users/1c75ad943261491fa9e4d4a548907dde => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:51.825255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb5876-cbce-41f5-a264-6220834aa49e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:51.889888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4a8e2-ed9e-42b6-81b8-dc3efd1c54b2 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:51.923713 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713f624-179d-4501-bf5b-81ccc0adb169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:51.924455 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713f624-179d-4501-bf5b-81ccc0adb169 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:51.924738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713f624-179d-4501-bf5b-81ccc0adb169 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:51.925014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713f624-179d-4501-bf5b-81ccc0adb169 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:51.925111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb5876-cbce-41f5-a264-6220834aa49e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:51.935402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713f624-179d-4501-bf5b-81ccc0adb169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-6713f624-179d-4501-bf5b-81ccc0adb169 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:51.940851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:51.942242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:51.943029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:51.943029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:51.943029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:51.943029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:51.943029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:51.943029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:51.943029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:51.943029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:51.943029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:51.943029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:51.943029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:51.943029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:51.943029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 165/329] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:51.943661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713f624-179d-4501-bf5b-81ccc0adb169 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:51.956215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:51.962561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01c7bc-8096-47d0-91af-8fdbe3b5cbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:51.963185 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01c7bc-8096-47d0-91af-8fdbe3b5cbb8 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:51.963465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01c7bc-8096-47d0-91af-8fdbe3b5cbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:51.963752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01c7bc-8096-47d0-91af-8fdbe3b5cbb8 None admin] PATH_INFO: `/v3/groups` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:51.964428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01c7bc-8096-47d0-91af-8fdbe3b5cbb8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:51.969874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01c7bc-8096-47d0-91af-8fdbe3b5cbb8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:51.986009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:52.021755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 165/330] 10.222.0.27 () {60 vars in 1134 bytes} [Mon Jul 25 21:24:51 2022] POST /identity/v3/groups => generated 226 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:24:52.023938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01c7bc-8096-47d0-91af-8fdbe3b5cbb8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:52.074683 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713f624-179d-4501-bf5b-81ccc0adb169 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:52.116690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542dad5-8cc7-44e1-a9e6-c76a52bb14f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:52.117636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542dad5-8cc7-44e1-a9e6-c76a52bb14f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:52.118069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542dad5-8cc7-44e1-a9e6-c76a52bb14f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:52.118356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542dad5-8cc7-44e1-a9e6-c76a52bb14f8 None admin] PATH_INFO: `/v3/system/users/1c75ad943261491fa9e4d4a548907dde/roles/0d4ee04c69134c1b81f17125e1b1c78d` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:52.120027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542dad5-8cc7-44e1-a9e6-c76a52bb14f8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1c75ad943261491fa9e4d4a548907dde, role_id=0d4ee04c69134c1b81f17125e1b1c78d)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:52.121431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542dad5-8cc7-44e1-a9e6-c76a52bb14f8 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:52.140162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01c7bc-8096-47d0-91af-8fdbe3b5cbb8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:52.179487 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7954978-2764-46b7-8008-2c8ac6d9b940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:52.180143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954978-2764-46b7-8008-2c8ac6d9b940 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:52.180458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954978-2764-46b7-8008-2c8ac6d9b940 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:52.180731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954978-2764-46b7-8008-2c8ac6d9b940 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:52.181457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7954978-2764-46b7-8008-2c8ac6d9b940 None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:52.181758 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7954978-2764-46b7-8008-2c8ac6d9b940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:52.183169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7954978-2764-46b7-8008-2c8ac6d9b940 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:52.192362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 166/331] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:52.197973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7954978-2764-46b7-8008-2c8ac6d9b940 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:52.209940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 166/332] 10.222.0.27 () {58 vars in 1334 bytes} [Mon Jul 25 21:24:51 2022] PUT /identity/v3/system/users/1c75ad943261491fa9e4d4a548907dde/roles/0d4ee04c69134c1b81f17125e1b1c78d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:24:52.262124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:52.321571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7954978-2764-46b7-8008-2c8ac6d9b940 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:52.360806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9afce-951d-4665-846d-d440ba31a4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:52.361419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9afce-951d-4665-846d-d440ba31a4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:52.361703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9afce-951d-4665-846d-d440ba31a4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:52.361977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9afce-951d-4665-846d-d440ba31a4b5 None admin] PATH_INFO: `/v3/users/bdcf1584b512475f9ea5253d38432f19` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:52.363228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9afce-951d-4665-846d-d440ba31a4b5 None admin] RBAC: Authorizing `identity:get_user(user_id=bdcf1584b512475f9ea5253d38432f19)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:52.365300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9afce-951d-4665-846d-d440ba31a4b5 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:52.367165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 167/333] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:52 2022] GET /identity/v3/users/bdcf1584b512475f9ea5253d38432f19 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:52.373024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542dad5-8cc7-44e1-a9e6-c76a52bb14f8 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:52.487725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542dad5-8cc7-44e1-a9e6-c76a52bb14f8 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:52.490641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:52.527312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9fc3d-853a-49e1-b560-a24be74b8a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:52.527973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9fc3d-853a-49e1-b560-a24be74b8a46 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:52.528264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9fc3d-853a-49e1-b560-a24be74b8a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:52.528531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9fc3d-853a-49e1-b560-a24be74b8a46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:52.529344 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9fc3d-853a-49e1-b560-a24be74b8a46 None admin] RBAC: Adding query filter params (role.id=59d226afaffe45f597d70faf647f2f22, user.id=bdcf1584b512475f9ea5253d38432f19, scope.system=all) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:52.529881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9fc3d-853a-49e1-b560-a24be74b8a46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:52.531817 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9fc3d-853a-49e1-b560-a24be74b8a46 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:52.545214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 167/334] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Jul 25 21:24:52 2022] GET /identity/v3/role_assignments?user.id=bdcf1584b512475f9ea5253d38432f19&scope.system=all&role.id=59d226afaffe45f597d70faf647f2f22 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:54.281630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dbbc9-dce8-46bf-a3e3-9e4ad939c357 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:54.282532 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dbbc9-dce8-46bf-a3e3-9e4ad939c357 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:54.283010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dbbc9-dce8-46bf-a3e3-9e4ad939c357 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:54.284848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 168/335] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:54.292384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff5100-6984-4cfb-90cd-b6831ee4c712 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:54.292842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff5100-6984-4cfb-90cd-b6831ee4c712 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:54.292915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff5100-6984-4cfb-90cd-b6831ee4c712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:54.320779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-00ff5100-6984-4cfb-90cd-b6831ee4c712 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:54.321977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-00ff5100-6984-4cfb-90cd-b6831ee4c712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:54.419485 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 168/336] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:54.469251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dbbc9-dce8-46bf-a3e3-9e4ad939c357 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:54.603680 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dbbc9-dce8-46bf-a3e3-9e4ad939c357 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:54.630666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:54.646675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36a60f-79f8-4392-a0b0-520749a86449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:54.647326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36a60f-79f8-4392-a0b0-520749a86449 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:54.647710 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36a60f-79f8-4392-a0b0-520749a86449 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:54.648017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36a60f-79f8-4392-a0b0-520749a86449 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:54.668671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36a60f-79f8-4392-a0b0-520749a86449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ab36a60f-79f8-4392-a0b0-520749a86449 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:54.673812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:54.674652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:54.676038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:54.676038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:54.676038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:54.676038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:54.676038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:54.676038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:54.676038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:54.676038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:54.676038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:54.676038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:54.676038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:54.676038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:54.676038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 169/337] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:54.682620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff5100-6984-4cfb-90cd-b6831ee4c712 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:54.735969 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac9fea-b259-4fdc-9266-a35a6338dd99 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:54.736248 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac9fea-b259-4fdc-9266-a35a6338dd99 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:54.736685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac9fea-b259-4fdc-9266-a35a6338dd99 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:54.739711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 170/338] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:54.745335 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ff208-735d-4fe9-a955-8775fab819f1 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:54.745607 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ff208-735d-4fe9-a955-8775fab819f1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:54.745960 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ff208-735d-4fe9-a955-8775fab819f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:54.784244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-675ff208-735d-4fe9-a955-8775fab819f1 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:54.786490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-675ff208-735d-4fe9-a955-8775fab819f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:54.836703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:54.852709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff5100-6984-4cfb-90cd-b6831ee4c712 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:54.903430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fff186-946e-4ae5-841f-e3dfa4064b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:54.904067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fff186-946e-4ae5-841f-e3dfa4064b23 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:54.904523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fff186-946e-4ae5-841f-e3dfa4064b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:54.904807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fff186-946e-4ae5-841f-e3dfa4064b23 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:54.905551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fff186-946e-4ae5-841f-e3dfa4064b23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:54.905994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fff186-946e-4ae5-841f-e3dfa4064b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:54.907227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fff186-946e-4ae5-841f-e3dfa4064b23 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:54.918448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 169/339] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:54.919931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39113a14-ecf6-4a03-ba0f-e8f24406478a None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:54.920231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39113a14-ecf6-4a03-ba0f-e8f24406478a None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:54.920508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39113a14-ecf6-4a03-ba0f-e8f24406478a None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:54.921807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 170/340] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:54.924101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 171/341] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:54.925046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39113a14-ecf6-4a03-ba0f-e8f24406478a None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:54.928828 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cbfdd-9193-43df-9b22-9a4dd55eb0c0 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:54.929193 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cbfdd-9193-43df-9b22-9a4dd55eb0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:54.929565 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cbfdd-9193-43df-9b22-9a4dd55eb0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:54.951230 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ad4cbfdd-9193-43df-9b22-9a4dd55eb0c0 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:54.952596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ad4cbfdd-9193-43df-9b22-9a4dd55eb0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:55.053869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 172/342] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:55.054711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cbfdd-9193-43df-9b22-9a4dd55eb0c0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:55.157021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:55.157882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39113a14-ecf6-4a03-ba0f-e8f24406478a None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:55.240186 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc72d8-660d-411d-a09f-2b21ffa63099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:55.240818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc72d8-660d-411d-a09f-2b21ffa63099 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:55.241094 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc72d8-660d-411d-a09f-2b21ffa63099 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:55.241363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc72d8-660d-411d-a09f-2b21ffa63099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:55.280089 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:55.283288 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cbfdd-9193-43df-9b22-9a4dd55eb0c0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:55.330464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb310a79-4132-4959-a72e-1fe48218d38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:55.331168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb310a79-4132-4959-a72e-1fe48218d38d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:55.331505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb310a79-4132-4959-a72e-1fe48218d38d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:55.331809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb310a79-4132-4959-a72e-1fe48218d38d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:55.345485 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb310a79-4132-4959-a72e-1fe48218d38d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-fb310a79-4132-4959-a72e-1fe48218d38d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:55.350804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:55.351668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:55.352497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:55.352497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:55.352497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:55.352497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:55.352497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:55.352497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:55.352497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:55.352497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:55.352497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:55.352497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:55.352497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 21:24:55.352497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:55.354203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 173/343] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:55.355155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb310a79-4132-4959-a72e-1fe48218d38d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:55.444694 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc72d8-660d-411d-a09f-2b21ffa63099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:55.446097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc72d8-660d-411d-a09f-2b21ffa63099 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:55.476335 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:55.480280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb310a79-4132-4959-a72e-1fe48218d38d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:55.526103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77518d-a920-413a-92c4-e75874cdc569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:55.526755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77518d-a920-413a-92c4-e75874cdc569 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:55.527035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77518d-a920-413a-92c4-e75874cdc569 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:55.527310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77518d-a920-413a-92c4-e75874cdc569 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:55.541770 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77518d-a920-413a-92c4-e75874cdc569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-9a77518d-a920-413a-92c4-e75874cdc569 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:55.547402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:55.552144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:55.552936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:55.552936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:55.552936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:55.552936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:55.552936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:55.552936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:55.552936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:55.552936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:55.552936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:55.552936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:55.552936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:55.552936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:55.552936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 174/344] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:24:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:55.552936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77518d-a920-413a-92c4-e75874cdc569 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:55.650640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 171/345] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:55.651542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc72d8-660d-411d-a09f-2b21ffa63099 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:55.700237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77518d-a920-413a-92c4-e75874cdc569 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:55.716166 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:55.740462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7221d-458f-4c19-bcf5-22fe9e11e347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:55.741242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7221d-458f-4c19-bcf5-22fe9e11e347 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:55.741630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7221d-458f-4c19-bcf5-22fe9e11e347 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:55.742006 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7221d-458f-4c19-bcf5-22fe9e11e347 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:55.742839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7221d-458f-4c19-bcf5-22fe9e11e347 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:55.743266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7221d-458f-4c19-bcf5-22fe9e11e347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:55.744811 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7221d-458f-4c19-bcf5-22fe9e11e347 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:55.759889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 175/346] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:55.761427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4085cd9-7903-4d1e-b025-54ce46759bbc None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:55.761825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4085cd9-7903-4d1e-b025-54ce46759bbc None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:55.762217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4085cd9-7903-4d1e-b025-54ce46759bbc None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:55.763911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 176/347] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:55.764701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4085cd9-7903-4d1e-b025-54ce46759bbc None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:55.772819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc72d8-660d-411d-a09f-2b21ffa63099 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:55.793523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:55.815629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40922ef-4ba8-4017-bee0-c2df3afa2dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:55.816296 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40922ef-4ba8-4017-bee0-c2df3afa2dcd None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:55.817941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40922ef-4ba8-4017-bee0-c2df3afa2dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:55.818236 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40922ef-4ba8-4017-bee0-c2df3afa2dcd None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:55.818976 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40922ef-4ba8-4017-bee0-c2df3afa2dcd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:55.819345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40922ef-4ba8-4017-bee0-c2df3afa2dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:55.820751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40922ef-4ba8-4017-bee0-c2df3afa2dcd None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:55.833480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 172/348] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:24:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:55.834400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40922ef-4ba8-4017-bee0-c2df3afa2dcd None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:55.879947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4085cd9-7903-4d1e-b025-54ce46759bbc None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:55.918296 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d84abe-cdee-4971-b5ad-be653339db41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:55.918988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d84abe-cdee-4971-b5ad-be653339db41 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:55.919282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d84abe-cdee-4971-b5ad-be653339db41 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:55.919560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d84abe-cdee-4971-b5ad-be653339db41 None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:55.920812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d84abe-cdee-4971-b5ad-be653339db41 None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:55.922231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d84abe-cdee-4971-b5ad-be653339db41 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:55.924291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 177/349] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:55 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:55.925537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afcb4c-7495-47c7-af08-b4b730a6255a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:55.925907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afcb4c-7495-47c7-af08-b4b730a6255a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:55.926702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afcb4c-7495-47c7-af08-b4b730a6255a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:55.947084 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f3afcb4c-7495-47c7-af08-b4b730a6255a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:55.948247 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f3afcb4c-7495-47c7-af08-b4b730a6255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:55.953836 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40922ef-4ba8-4017-bee0-c2df3afa2dcd None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:55.971465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:55.992767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83e1f7-513f-4cb9-93d4-69f995c7c049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:55.993530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83e1f7-513f-4cb9-93d4-69f995c7c049 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:55.993936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83e1f7-513f-4cb9-93d4-69f995c7c049 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:55.994222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83e1f7-513f-4cb9-93d4-69f995c7c049 None admin] PATH_INFO: `/v3/users/1c75ad943261491fa9e4d4a548907dde` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:55.995601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83e1f7-513f-4cb9-93d4-69f995c7c049 None admin] RBAC: Authorizing `identity:get_user(user_id=1c75ad943261491fa9e4d4a548907dde)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:55.997201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83e1f7-513f-4cb9-93d4-69f995c7c049 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:56.000493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 173/350] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:24:55 2022] GET /identity/v3/users/1c75ad943261491fa9e4d4a548907dde => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:56.001062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83e1f7-513f-4cb9-93d4-69f995c7c049 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:56.032212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 178/351] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:56.033383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afcb4c-7495-47c7-af08-b4b730a6255a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:56.060146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:56.142602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83e1f7-513f-4cb9-93d4-69f995c7c049 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:56.151548 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afcb4c-7495-47c7-af08-b4b730a6255a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:56.192480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3ada2-9239-4fbc-9dd3-e5e1b1b68330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:56.192686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead535d8-04ec-4a69-a8af-c951fae2f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:56.193197 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3ada2-9239-4fbc-9dd3-e5e1b1b68330 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:56.193325 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead535d8-04ec-4a69-a8af-c951fae2f010 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:56.193490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3ada2-9239-4fbc-9dd3-e5e1b1b68330 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:56.193764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3ada2-9239-4fbc-9dd3-e5e1b1b68330 None admin] PATH_INFO: `/v3/groups/537dbfb30d504705813ec62de052d57c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:56.193862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead535d8-04ec-4a69-a8af-c951fae2f010 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:56.194128 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead535d8-04ec-4a69-a8af-c951fae2f010 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:56.202177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3ada2-9239-4fbc-9dd3-e5e1b1b68330 None admin] RBAC: Authorizing `identity:get_group(group_id=537dbfb30d504705813ec62de052d57c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:56.203588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3ada2-9239-4fbc-9dd3-e5e1b1b68330 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:56.206368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 179/352] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:24:56 2022] GET /identity/v3/groups/537dbfb30d504705813ec62de052d57c => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:56.208294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3ada2-9239-4fbc-9dd3-e5e1b1b68330 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:56.256134 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:56.277370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead535d8-04ec-4a69-a8af-c951fae2f010 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:56.278863 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead535d8-04ec-4a69-a8af-c951fae2f010 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:56.318483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:56.336528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3ada2-9239-4fbc-9dd3-e5e1b1b68330 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:56.387471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 174/353] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:56.388356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead535d8-04ec-4a69-a8af-c951fae2f010 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:56.397874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b18a0-bfdb-49b8-812f-03e2828e98e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:56.398517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b18a0-bfdb-49b8-812f-03e2828e98e7 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:56.398805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b18a0-bfdb-49b8-812f-03e2828e98e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:56.399083 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b18a0-bfdb-49b8-812f-03e2828e98e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:56.399924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b18a0-bfdb-49b8-812f-03e2828e98e7 None admin] RBAC: Adding query filter params (role.id=0d4ee04c69134c1b81f17125e1b1c78d, user.id=1c75ad943261491fa9e4d4a548907dde, scope.system=all) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:56.400240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b18a0-bfdb-49b8-812f-03e2828e98e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:56.401693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b18a0-bfdb-49b8-812f-03e2828e98e7 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:56.417455 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 180/354] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Jul 25 21:24:56 2022] GET /identity/v3/role_assignments?user.id=1c75ad943261491fa9e4d4a548907dde&scope.system=all&role.id=0d4ee04c69134c1b81f17125e1b1c78d => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:56.418720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b18a0-bfdb-49b8-812f-03e2828e98e7 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:56.483203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:56.509350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead535d8-04ec-4a69-a8af-c951fae2f010 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:56.545901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b18a0-bfdb-49b8-812f-03e2828e98e7 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:56.561483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e3d54-5222-4e93-9dbe-f2a302f3e3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:56.562501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e3d54-5222-4e93-9dbe-f2a302f3e3fb None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:56.562821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e3d54-5222-4e93-9dbe-f2a302f3e3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:56.563242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e3d54-5222-4e93-9dbe-f2a302f3e3fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:56.578623 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e3d54-5222-4e93-9dbe-f2a302f3e3fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-985e3d54-5222-4e93-9dbe-f2a302f3e3fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:56.585436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:56.586384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:56.587693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:56.587693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:56.587693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:56.587693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:56.587693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:56.587693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:56.587693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:56.587693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:56.587693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:56.587693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:56.587693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:56.587693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:24:56.591798 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 175/355] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:56.592813 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e3d54-5222-4e93-9dbe-f2a302f3e3fb None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:56.603762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad4281-70aa-4939-a925-a16332d12699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:56.604729 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad4281-70aa-4939-a925-a16332d12699 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:56.605205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad4281-70aa-4939-a925-a16332d12699 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:56.605672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad4281-70aa-4939-a925-a16332d12699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:56.606695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad4281-70aa-4939-a925-a16332d12699 None admin] RBAC: Adding query filter params (group.id=537dbfb30d504705813ec62de052d57c, role.id=59d226afaffe45f597d70faf647f2f22, scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:56.607229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad4281-70aa-4939-a925-a16332d12699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:56.609038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad4281-70aa-4939-a925-a16332d12699 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:56.617719 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 181/356] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 21:24:56 2022] GET /identity/v3/role_assignments?group.id=537dbfb30d504705813ec62de052d57c&scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33&role.id=59d226afaffe45f597d70faf647f2f22 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:56.620989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa9373-bc11-4710-95b1-cb2f21c58736 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:56.621273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa9373-bc11-4710-95b1-cb2f21c58736 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:56.621542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa9373-bc11-4710-95b1-cb2f21c58736 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:56.622795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 182/357] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:56.627417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa9373-bc11-4710-95b1-cb2f21c58736 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:56.642534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:56.741498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e3d54-5222-4e93-9dbe-f2a302f3e3fb None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:56.787571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d76d5-eafd-43cb-93b0-10bb45c277fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:56.788770 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d76d5-eafd-43cb-93b0-10bb45c277fa None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:56.789267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d76d5-eafd-43cb-93b0-10bb45c277fa None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:56.789761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d76d5-eafd-43cb-93b0-10bb45c277fa None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:56.791288 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d76d5-eafd-43cb-93b0-10bb45c277fa None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:56.791963 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa9373-bc11-4710-95b1-cb2f21c58736 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:56.793275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d76d5-eafd-43cb-93b0-10bb45c277fa None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:56.795430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 176/358] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:56 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:56.796878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849152a7-47a9-47f9-9ba7-8c3d39adda4f None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:56.797903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849152a7-47a9-47f9-9ba7-8c3d39adda4f None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:56.798404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849152a7-47a9-47f9-9ba7-8c3d39adda4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:56.821073 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-849152a7-47a9-47f9-9ba7-8c3d39adda4f None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:56.822746 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-849152a7-47a9-47f9-9ba7-8c3d39adda4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:56.826407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:56.832781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeabc37-b899-4940-829e-27e2ea5a868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:56.833941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeabc37-b899-4940-829e-27e2ea5a868a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:56.834464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeabc37-b899-4940-829e-27e2ea5a868a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:56.834950 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeabc37-b899-4940-829e-27e2ea5a868a None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:56.836219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeabc37-b899-4940-829e-27e2ea5a868a None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:56.843958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeabc37-b899-4940-829e-27e2ea5a868a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:56.843958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeabc37-b899-4940-829e-27e2ea5a868a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:56.849626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 183/359] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:56.850780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeabc37-b899-4940-829e-27e2ea5a868a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:56.906129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 177/360] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:56.907351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849152a7-47a9-47f9-9ba7-8c3d39adda4f None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:56.937308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:56.977079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeabc37-b899-4940-829e-27e2ea5a868a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:57.023662 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f2850-09ed-450d-bf86-910b1575c862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:57.024614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f2850-09ed-450d-bf86-910b1575c862 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:57.024900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f2850-09ed-450d-bf86-910b1575c862 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:57.025181 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f2850-09ed-450d-bf86-910b1575c862 None admin] PATH_INFO: `/v3/groups/537dbfb30d504705813ec62de052d57c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:57.026945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f2850-09ed-450d-bf86-910b1575c862 None admin] RBAC: Authorizing `identity:get_group(group_id=537dbfb30d504705813ec62de052d57c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:57.028509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f2850-09ed-450d-bf86-910b1575c862 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:57.030484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 184/361] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:24:56 2022] GET /identity/v3/groups/537dbfb30d504705813ec62de052d57c => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:57.031716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cd5ce-8753-4e3b-9e38-fe15140a6c5e None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:57.032032 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cd5ce-8753-4e3b-9e38-fe15140a6c5e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:57.032306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cd5ce-8753-4e3b-9e38-fe15140a6c5e None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:57.033664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 185/362] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:57.034211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cd5ce-8753-4e3b-9e38-fe15140a6c5e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:57.036373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849152a7-47a9-47f9-9ba7-8c3d39adda4f None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:57.078700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacf5f6-6737-47d0-9f96-cbcf6cdbb964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:57.079333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacf5f6-6737-47d0-9f96-cbcf6cdbb964 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:57.079613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacf5f6-6737-47d0-9f96-cbcf6cdbb964 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:57.079925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacf5f6-6737-47d0-9f96-cbcf6cdbb964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:57.092601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:57.170932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacf5f6-6737-47d0-9f96-cbcf6cdbb964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:57.172883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacf5f6-6737-47d0-9f96-cbcf6cdbb964 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:57.173307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cd5ce-8753-4e3b-9e38-fe15140a6c5e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:57.214024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca40b18-4602-4e37-8a6b-78d76e2f6e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:57.215087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca40b18-4602-4e37-8a6b-78d76e2f6e6d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:57.215570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca40b18-4602-4e37-8a6b-78d76e2f6e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:57.216029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca40b18-4602-4e37-8a6b-78d76e2f6e6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:57.219152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:57.229387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca40b18-4602-4e37-8a6b-78d76e2f6e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2ca40b18-4602-4e37-8a6b-78d76e2f6e6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:57.234961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:57.236045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:57.236884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:57.236884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:57.236884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:57.236884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:57.236884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:57.236884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:57.236884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:57.236884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:57.236884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:57.236884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:57.236884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:24:57.236884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:57.236884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 186/363] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:24:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:57.237587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca40b18-4602-4e37-8a6b-78d76e2f6e6d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:57.308772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 178/364] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:57.310334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1346-b506-4b68-8d50-3439cc854c1c None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:57.311021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1346-b506-4b68-8d50-3439cc854c1c None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:57.311580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1346-b506-4b68-8d50-3439cc854c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:57.332617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-5f5c1346-b506-4b68-8d50-3439cc854c1c None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:57.334446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-5f5c1346-b506-4b68-8d50-3439cc854c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:57.371313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca40b18-4602-4e37-8a6b-78d76e2f6e6d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:57.373860 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:57.413155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 179/365] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:57.413355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea4d45-e16d-420a-9b8f-64af6e706f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:57.414233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea4d45-e16d-420a-9b8f-64af6e706f53 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:57.414344 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c1346-b506-4b68-8d50-3439cc854c1c None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:57.414434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea4d45-e16d-420a-9b8f-64af6e706f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:57.414434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea4d45-e16d-420a-9b8f-64af6e706f53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:57.416799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea4d45-e16d-420a-9b8f-64af6e706f53 None admin] RBAC: Adding query filter params (group.id=537dbfb30d504705813ec62de052d57c, role.id=8595eaa9629b4ec4a628d662402fd25d, scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:57.416799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea4d45-e16d-420a-9b8f-64af6e706f53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:57.417543 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea4d45-e16d-420a-9b8f-64af6e706f53 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:57.423468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 187/366] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 21:24:57 2022] GET /identity/v3/role_assignments?group.id=537dbfb30d504705813ec62de052d57c&scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33&role.id=8595eaa9629b4ec4a628d662402fd25d => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:57.424525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea4d45-e16d-420a-9b8f-64af6e706f53 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:57.501153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:57.550248 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea4d45-e16d-420a-9b8f-64af6e706f53 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:57.567202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c1346-b506-4b68-8d50-3439cc854c1c None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:57.605803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d46a2-584c-4140-8b7d-83b747a10ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:57.606543 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d46a2-584c-4140-8b7d-83b747a10ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:57.606759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d46a2-584c-4140-8b7d-83b747a10ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:57.607024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d46a2-584c-4140-8b7d-83b747a10ad2 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:57.608459 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d46a2-584c-4140-8b7d-83b747a10ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:57.609951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d46a2-584c-4140-8b7d-83b747a10ad2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:57.615204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 188/367] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:57 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:57.616040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d46a2-584c-4140-8b7d-83b747a10ad2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:57.627969 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4fc8f-9d43-477a-8f5c-6a247be4c54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:57.628765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4fc8f-9d43-477a-8f5c-6a247be4c54e None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:57.629631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4fc8f-9d43-477a-8f5c-6a247be4c54e None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:57.630003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4fc8f-9d43-477a-8f5c-6a247be4c54e None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:57.630783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4fc8f-9d43-477a-8f5c-6a247be4c54e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:57.631045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4fc8f-9d43-477a-8f5c-6a247be4c54e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:57.632444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4fc8f-9d43-477a-8f5c-6a247be4c54e None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:57.641617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 180/368] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:24:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:57.642442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4fc8f-9d43-477a-8f5c-6a247be4c54e None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:57.692834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:57.744362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d46a2-584c-4140-8b7d-83b747a10ad2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:57.773458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:57.783734 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccf585-0d1f-4261-90ee-d8de5c19393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:57.785576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccf585-0d1f-4261-90ee-d8de5c19393d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:57.785576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccf585-0d1f-4261-90ee-d8de5c19393d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:57.785576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccf585-0d1f-4261-90ee-d8de5c19393d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:57.788972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4fc8f-9d43-477a-8f5c-6a247be4c54e None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:57.802222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccf585-0d1f-4261-90ee-d8de5c19393d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-39ccf585-0d1f-4261-90ee-d8de5c19393d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:57.809457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:57.810556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:57.811526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:57.811526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:57.811526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:57.811526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:57.811526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:57.811526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:57.811526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:57.811526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:57.811526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:57.811526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:57.811526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:24:57.811526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:57.813972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 189/369] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:24:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:57.814848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccf585-0d1f-4261-90ee-d8de5c19393d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:57.856627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d2237-3fa8-42af-be2b-3414eddcbee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:57.857661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d2237-3fa8-42af-be2b-3414eddcbee4 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:57.858047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d2237-3fa8-42af-be2b-3414eddcbee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:57.858464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d2237-3fa8-42af-be2b-3414eddcbee4 None admin] PATH_INFO: `/v3/groups/537dbfb30d504705813ec62de052d57c` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:57.860783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d2237-3fa8-42af-be2b-3414eddcbee4 None admin] RBAC: Authorizing `identity:get_group(group_id=537dbfb30d504705813ec62de052d57c)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:57.862359 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d2237-3fa8-42af-be2b-3414eddcbee4 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:57.865117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 181/370] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:24:57 2022] GET /identity/v3/groups/537dbfb30d504705813ec62de052d57c => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:57.866168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d2237-3fa8-42af-be2b-3414eddcbee4 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:57.947544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccf585-0d1f-4261-90ee-d8de5c19393d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:58.004963 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34e74a-d292-4a32-bf87-f907129ab5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:58.005898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34e74a-d292-4a32-bf87-f907129ab5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:58.006446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34e74a-d292-4a32-bf87-f907129ab5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:58.006872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34e74a-d292-4a32-bf87-f907129ab5c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:58.007554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:58.010869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d2237-3fa8-42af-be2b-3414eddcbee4 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:58.056323 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e13561-f9a3-4384-9246-5f0f783dd80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:58.057350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e13561-f9a3-4384-9246-5f0f783dd80d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:58.057849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e13561-f9a3-4384-9246-5f0f783dd80d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:58.058334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e13561-f9a3-4384-9246-5f0f783dd80d None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:58.059267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e13561-f9a3-4384-9246-5f0f783dd80d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:58.059894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e13561-f9a3-4384-9246-5f0f783dd80d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:58.061579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e13561-f9a3-4384-9246-5f0f783dd80d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:58.073410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 182/371] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:58.074542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e13561-f9a3-4384-9246-5f0f783dd80d None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:58.081226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:58.096192 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34e74a-d292-4a32-bf87-f907129ab5c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:58.098412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34e74a-d292-4a32-bf87-f907129ab5c8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:58.203195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e13561-f9a3-4384-9246-5f0f783dd80d None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:58.223654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 190/372] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:58.225159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34e74a-d292-4a32-bf87-f907129ab5c8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:58.247504 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dbf1a-3508-4a78-b20a-226445963a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:58.248234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dbf1a-3508-4a78-b20a-226445963a5e None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:58.248446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dbf1a-3508-4a78-b20a-226445963a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:58.248724 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dbf1a-3508-4a78-b20a-226445963a5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:58.249537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dbf1a-3508-4a78-b20a-226445963a5e None admin] RBAC: Adding query filter params (group.id=537dbfb30d504705813ec62de052d57c, role.id=59d226afaffe45f597d70faf647f2f22, scope.project.id=afcb05e9da4b4207af59800fe02b4346) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:58.249849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dbf1a-3508-4a78-b20a-226445963a5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:58.251290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dbf1a-3508-4a78-b20a-226445963a5e None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:58.258357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 183/373] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 21:24:58 2022] GET /identity/v3/role_assignments?group.id=537dbfb30d504705813ec62de052d57c&scope.project.id=afcb05e9da4b4207af59800fe02b4346&role.id=59d226afaffe45f597d70faf647f2f22 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:58.259189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dbf1a-3508-4a78-b20a-226445963a5e None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:58.297095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:58.373426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:58.393200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34e74a-d292-4a32-bf87-f907129ab5c8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:58.399463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dbf1a-3508-4a78-b20a-226445963a5e None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:58.445999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f08171-b2c0-449b-9ab2-fc9f74d26f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:58.446848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f08171-b2c0-449b-9ab2-fc9f74d26f36 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:58.447274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f08171-b2c0-449b-9ab2-fc9f74d26f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:58.447515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f08171-b2c0-449b-9ab2-fc9f74d26f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:58.447686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7912f-429e-44b8-aeac-d5d44b910f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:58.448381 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7912f-429e-44b8-aeac-d5d44b910f81 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:58.448788 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7912f-429e-44b8-aeac-d5d44b910f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:58.449085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7912f-429e-44b8-aeac-d5d44b910f81 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:58.450483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7912f-429e-44b8-aeac-d5d44b910f81 None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:58.451964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7912f-429e-44b8-aeac-d5d44b910f81 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:58.453807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 184/374] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:58 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:58.463810 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7912f-429e-44b8-aeac-d5d44b910f81 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:58.537421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f08171-b2c0-449b-9ab2-fc9f74d26f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:58.538993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f08171-b2c0-449b-9ab2-fc9f74d26f36 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:58.567428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:58.575252 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7912f-429e-44b8-aeac-d5d44b910f81 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:58.614635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c9719-4566-4e58-a218-b0e0c3a775bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:58.615291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c9719-4566-4e58-a218-b0e0c3a775bd None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:58.615577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c9719-4566-4e58-a218-b0e0c3a775bd None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:58.615904 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c9719-4566-4e58-a218-b0e0c3a775bd None admin] PATH_INFO: `/v3/groups/537dbfb30d504705813ec62de052d57c` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:58.617101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c9719-4566-4e58-a218-b0e0c3a775bd None admin] RBAC: Authorizing `identity:get_group(group_id=537dbfb30d504705813ec62de052d57c)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:58.618540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c9719-4566-4e58-a218-b0e0c3a775bd None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:58.620480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 185/375] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:24:58 2022] GET /identity/v3/groups/537dbfb30d504705813ec62de052d57c => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:58.630714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c9719-4566-4e58-a218-b0e0c3a775bd None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:58.651310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:58.668457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 191/376] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:24:58.676361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f08171-b2c0-449b-9ab2-fc9f74d26f36 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:58.794600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f08171-b2c0-449b-9ab2-fc9f74d26f36 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:58.806959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c9719-4566-4e58-a218-b0e0c3a775bd None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:58.836578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039046e-0627-4e78-aecf-32ebd9718125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:58.837235 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039046e-0627-4e78-aecf-32ebd9718125 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:58.837521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039046e-0627-4e78-aecf-32ebd9718125 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:58.837799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039046e-0627-4e78-aecf-32ebd9718125 None admin] PATH_INFO: `/v3/projects/e47334e4e95e4979a35529036ec99feb` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:58.839185 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039046e-0627-4e78-aecf-32ebd9718125 None admin] RBAC: Authorizing `identity:get_project(project_id=e47334e4e95e4979a35529036ec99feb)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:58.840665 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039046e-0627-4e78-aecf-32ebd9718125 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:58.842504 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 192/377] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:24:58 2022] GET /identity/v3/projects/e47334e4e95e4979a35529036ec99feb => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:24:58.843953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721315fe-23f4-4163-89e1-14b7cc96d6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:58.844647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721315fe-23f4-4163-89e1-14b7cc96d6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:58.844937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721315fe-23f4-4163-89e1-14b7cc96d6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:58.845215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721315fe-23f4-4163-89e1-14b7cc96d6d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:58.846016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721315fe-23f4-4163-89e1-14b7cc96d6d0 None admin] RBAC: Adding query filter params (group.id=537dbfb30d504705813ec62de052d57c, role.id=8595eaa9629b4ec4a628d662402fd25d, scope.project.id=afcb05e9da4b4207af59800fe02b4346) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:58.846328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721315fe-23f4-4163-89e1-14b7cc96d6d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:58.848856 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721315fe-23f4-4163-89e1-14b7cc96d6d0 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:58.851448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039046e-0627-4e78-aecf-32ebd9718125 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:58.859018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 186/378] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 21:24:58 2022] GET /identity/v3/role_assignments?group.id=537dbfb30d504705813ec62de052d57c&scope.project.id=afcb05e9da4b4207af59800fe02b4346&role.id=8595eaa9629b4ec4a628d662402fd25d => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:58.924581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:58.992557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039046e-0627-4e78-aecf-32ebd9718125 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:59.035814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55318dcf-0413-43e8-bd3a-945444dc9dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:59.036497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55318dcf-0413-43e8-bd3a-945444dc9dca None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:59.037044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55318dcf-0413-43e8-bd3a-945444dc9dca None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:59.037329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55318dcf-0413-43e8-bd3a-945444dc9dca None admin] PATH_INFO: `/v3/groups/431297cc0a8248e8a1bccd45be5c3dd1` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:59.042950 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55318dcf-0413-43e8-bd3a-945444dc9dca None admin] RBAC: Authorizing `identity:get_group(group_id=431297cc0a8248e8a1bccd45be5c3dd1)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:59.044458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55318dcf-0413-43e8-bd3a-945444dc9dca None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:59.046580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 193/379] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:24:58 2022] GET /identity/v3/groups/431297cc0a8248e8a1bccd45be5c3dd1 => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:59.052824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721315fe-23f4-4163-89e1-14b7cc96d6d0 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:59.092152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:59.179040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721315fe-23f4-4163-89e1-14b7cc96d6d0 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:59.217032 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b13352-9f7b-4380-89e5-5327b9253f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:59.217982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b13352-9f7b-4380-89e5-5327b9253f85 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:59.218454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b13352-9f7b-4380-89e5-5327b9253f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:59.218915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b13352-9f7b-4380-89e5-5327b9253f85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:59.219911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b13352-9f7b-4380-89e5-5327b9253f85 None admin] RBAC: Adding query filter params (group.id=431297cc0a8248e8a1bccd45be5c3dd1, role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=e47334e4e95e4979a35529036ec99feb) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:59.220417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b13352-9f7b-4380-89e5-5327b9253f85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:59.222040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b13352-9f7b-4380-89e5-5327b9253f85 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:59.229077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 187/380] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 21:24:59 2022] GET /identity/v3/role_assignments?group.id=431297cc0a8248e8a1bccd45be5c3dd1&scope.project.id=e47334e4e95e4979a35529036ec99feb&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:59.331189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0749ea-433a-4af6-8eab-b32f7b476dbf None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:59.331889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0749ea-433a-4af6-8eab-b32f7b476dbf None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:59.332353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0749ea-433a-4af6-8eab-b32f7b476dbf None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:59.334035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 194/381] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:24:59.340092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7f3d8-19ac-4da5-9a92-f24712e691f7 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:59.340690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7f3d8-19ac-4da5-9a92-f24712e691f7 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:59.341177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7f3d8-19ac-4da5-9a92-f24712e691f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:59.365014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-6cb7f3d8-19ac-4da5-9a92-f24712e691f7 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:24:59.366589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-6cb7f3d8-19ac-4da5-9a92-f24712e691f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:24:59.454250 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 188/382] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:24:59.485219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0749ea-433a-4af6-8eab-b32f7b476dbf None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:59.611399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0749ea-433a-4af6-8eab-b32f7b476dbf None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:59.641718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:59.659405 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10e6f6-c21b-45a0-8cee-1f442afe87c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:59.660682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10e6f6-c21b-45a0-8cee-1f442afe87c4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:59.660959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10e6f6-c21b-45a0-8cee-1f442afe87c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:59.661236 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10e6f6-c21b-45a0-8cee-1f442afe87c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:59.679044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10e6f6-c21b-45a0-8cee-1f442afe87c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-0e10e6f6-c21b-45a0-8cee-1f442afe87c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:24:59.685584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:24:59.686470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:24:59.687256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:24:59.687256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:24:59.687256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:24:59.687256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:24:59.687256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:24:59.687256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:24:59.687256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:24:59.687256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:24:59.687256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:24:59.687256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:24:59.687256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:24:59.687256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:24:59.687256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 195/383] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:24:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:24:59.694933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7f3d8-19ac-4da5-9a92-f24712e691f7 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:24:59.736065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:24:59.832165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7f3d8-19ac-4da5-9a92-f24712e691f7 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:24:59.887310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e9d01-c179-45dc-976f-5eea9232061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:24:59.887886 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e9d01-c179-45dc-976f-5eea9232061c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:24:59.888168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e9d01-c179-45dc-976f-5eea9232061c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:24:59.888441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e9d01-c179-45dc-976f-5eea9232061c None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:24:59.889166 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e9d01-c179-45dc-976f-5eea9232061c None admin] RBAC: Adding query filter params (name=member) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:24:59.889465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e9d01-c179-45dc-976f-5eea9232061c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:24:59.890848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e9d01-c179-45dc-976f-5eea9232061c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:24:59.903292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 189/384] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:24:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:24:59.909119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10e6f6-c21b-45a0-8cee-1f442afe87c4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:00.060858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10e6f6-c21b-45a0-8cee-1f442afe87c4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:00.103006 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a025221-9ce2-4964-b68e-41cf9548682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:00.103660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a025221-9ce2-4964-b68e-41cf9548682e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:00.103975 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a025221-9ce2-4964-b68e-41cf9548682e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:00.104254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a025221-9ce2-4964-b68e-41cf9548682e None admin] PATH_INFO: `/v3/groups/537dbfb30d504705813ec62de052d57c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:00.105425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a025221-9ce2-4964-b68e-41cf9548682e None admin] RBAC: Authorizing `identity:get_group(group_id=537dbfb30d504705813ec62de052d57c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:00.106872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a025221-9ce2-4964-b68e-41cf9548682e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:00.108498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 196/385] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:24:59 2022] GET /identity/v3/groups/537dbfb30d504705813ec62de052d57c => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:00.115300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e9d01-c179-45dc-976f-5eea9232061c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:00.246618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:00.266613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e9d01-c179-45dc-976f-5eea9232061c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:00.313439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e18b1-c1ad-4f7b-bf76-30ecea58e8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:00.314090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e18b1-c1ad-4f7b-bf76-30ecea58e8bf None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:00.314366 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e18b1-c1ad-4f7b-bf76-30ecea58e8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:00.314635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e18b1-c1ad-4f7b-bf76-30ecea58e8bf None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:00.315850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e18b1-c1ad-4f7b-bf76-30ecea58e8bf None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:00.317837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e18b1-c1ad-4f7b-bf76-30ecea58e8bf None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:00.319860 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 190/386] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:25:00 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:00.325645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a025221-9ce2-4964-b68e-41cf9548682e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:00.327162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a8b3-ac55-4f0e-a202-15a05d298194 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:00.327447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a8b3-ac55-4f0e-a202-15a05d298194 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:00.327725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3a8b3-ac55-4f0e-a202-15a05d298194 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:00.329202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 191/387] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:25:00.344225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb50cf3-b51f-435b-a826-3037f755b94d None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:00.344538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb50cf3-b51f-435b-a826-3037f755b94d None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:00.344775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb50cf3-b51f-435b-a826-3037f755b94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:00.374118 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-0eb50cf3-b51f-435b-a826-3037f755b94d None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:00.375302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-0eb50cf3-b51f-435b-a826-3037f755b94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:00.418659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:00.503257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 192/388] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:25:00.514135 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a025221-9ce2-4964-b68e-41cf9548682e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:00.529282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb50cf3-b51f-435b-a826-3037f755b94d None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:00.580596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a604d42-9eaf-4b56-b18a-fe0da7f25016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:00.584381 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a604d42-9eaf-4b56-b18a-fe0da7f25016 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:00.584899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a604d42-9eaf-4b56-b18a-fe0da7f25016 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:00.585382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a604d42-9eaf-4b56-b18a-fe0da7f25016 None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33/groups/537dbfb30d504705813ec62de052d57c/roles/59d226afaffe45f597d70faf647f2f22` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:00.588722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a604d42-9eaf-4b56-b18a-fe0da7f25016 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee4e6637d7984dabbbe2d7d731b48a33, group_id=537dbfb30d504705813ec62de052d57c, role_id=59d226afaffe45f597d70faf647f2f22)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:00.590404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a604d42-9eaf-4b56-b18a-fe0da7f25016 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:00.646759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:00.670989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 197/389] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 25 21:25:00 2022] PUT /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33/groups/537dbfb30d504705813ec62de052d57c/roles/59d226afaffe45f597d70faf647f2f22 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:25:00.678223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb50cf3-b51f-435b-a826-3037f755b94d None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:00.720706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf661e-3c20-4237-8f9c-270da4608a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:00.721489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf661e-3c20-4237-8f9c-270da4608a8b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:00.721729 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf661e-3c20-4237-8f9c-270da4608a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:00.722008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf661e-3c20-4237-8f9c-270da4608a8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:00.739844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf661e-3c20-4237-8f9c-270da4608a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-fdcf661e-3c20-4237-8f9c-270da4608a8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:00.745408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:00.746327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:00.747146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:00.747146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:00.747146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:00.747146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:00.747146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:00.747146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:00.747146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:00.747146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:00.747146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:00.747146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:00.747146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:25:00.747146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:00.747146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 193/390] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:25:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:00.753028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a604d42-9eaf-4b56-b18a-fe0da7f25016 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:00.873108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a604d42-9eaf-4b56-b18a-fe0da7f25016 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:00.883890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:00.920610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf463ce-4eae-4bbc-839b-7ee7f957d41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:00.921321 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf463ce-4eae-4bbc-839b-7ee7f957d41b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:00.921614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf463ce-4eae-4bbc-839b-7ee7f957d41b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:00.921896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf463ce-4eae-4bbc-839b-7ee7f957d41b None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:00.922640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf463ce-4eae-4bbc-839b-7ee7f957d41b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:00.923395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf463ce-4eae-4bbc-839b-7ee7f957d41b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:00.924903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf463ce-4eae-4bbc-839b-7ee7f957d41b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:00.940356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 198/391] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:00.946659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf661e-3c20-4237-8f9c-270da4608a8b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:01.064200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf661e-3c20-4237-8f9c-270da4608a8b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:01.103177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85b21e-0060-477f-8cc1-a719be22e883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:01.103868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85b21e-0060-477f-8cc1-a719be22e883 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:01.104154 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85b21e-0060-477f-8cc1-a719be22e883 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:01.104427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85b21e-0060-477f-8cc1-a719be22e883 None admin] PATH_INFO: `/v3/groups/537dbfb30d504705813ec62de052d57c` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:01.105602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85b21e-0060-477f-8cc1-a719be22e883 None admin] RBAC: Authorizing `identity:get_group(group_id=537dbfb30d504705813ec62de052d57c)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:01.107060 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85b21e-0060-477f-8cc1-a719be22e883 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:01.108083 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f738c-a997-4136-b033-8e76b06ed1d9 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:01.108575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f738c-a997-4136-b033-8e76b06ed1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:01.109043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f738c-a997-4136-b033-8e76b06ed1d9 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:01.109144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 194/392] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:25:00 2022] GET /identity/v3/groups/537dbfb30d504705813ec62de052d57c => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:01.110976 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 199/393] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:01.115227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85b21e-0060-477f-8cc1-a719be22e883 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:01.117934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3dfae-92e6-4cd7-9c5f-93bbb48ccd8f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:01.118445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3dfae-92e6-4cd7-9c5f-93bbb48ccd8f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:01.118938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3dfae-92e6-4cd7-9c5f-93bbb48ccd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:01.128298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:01.143247 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e3f3dfae-92e6-4cd7-9c5f-93bbb48ccd8f None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:01.145032 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e3f3dfae-92e6-4cd7-9c5f-93bbb48ccd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:01.238993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 200/394] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:25:01.254223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85b21e-0060-477f-8cc1-a719be22e883 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:01.262773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3dfae-92e6-4cd7-9c5f-93bbb48ccd8f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:01.331920 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40153b8b-aa76-48b6-9677-4e1f5741c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:01.332581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153b8b-aa76-48b6-9677-4e1f5741c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:01.332865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153b8b-aa76-48b6-9677-4e1f5741c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:01.333142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153b8b-aa76-48b6-9677-4e1f5741c0c6 None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:01.334399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40153b8b-aa76-48b6-9677-4e1f5741c0c6 None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:01.335876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40153b8b-aa76-48b6-9677-4e1f5741c0c6 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:01.338236 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 195/395] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:25:01 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:01.347890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40153b8b-aa76-48b6-9677-4e1f5741c0c6 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:01.459377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:01.469891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:01.472734 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3dfae-92e6-4cd7-9c5f-93bbb48ccd8f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:01.496703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40153b8b-aa76-48b6-9677-4e1f5741c0c6 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:01.518978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fb7b6-e9dd-4eee-af7e-768d9d2e707f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:01.520586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fb7b6-e9dd-4eee-af7e-768d9d2e707f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:01.521068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fb7b6-e9dd-4eee-af7e-768d9d2e707f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:01.521690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fb7b6-e9dd-4eee-af7e-768d9d2e707f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:01.533734 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fb559-881e-4ac3-91e6-4416114a7f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:01.534656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fb559-881e-4ac3-91e6-4416114a7f36 None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:01.535038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fb559-881e-4ac3-91e6-4416114a7f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:01.535528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fb7b6-e9dd-4eee-af7e-768d9d2e707f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:01.535865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fb559-881e-4ac3-91e6-4416114a7f36 None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33/groups/537dbfb30d504705813ec62de052d57c/roles/8595eaa9629b4ec4a628d662402fd25d` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:01.538830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fb559-881e-4ac3-91e6-4416114a7f36 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee4e6637d7984dabbbe2d7d731b48a33, group_id=537dbfb30d504705813ec62de052d57c, role_id=8595eaa9629b4ec4a628d662402fd25d)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:01.540486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fb559-881e-4ac3-91e6-4416114a7f36 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-8a5fb7b6-e9dd-4eee-af7e-768d9d2e707f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:01.541309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:01.542333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:01.543188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:01.543188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:01.543188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:01.543188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:01.543188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:01.543188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:01.543188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:01.543188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:01.543188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:01.543188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:01.543188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:25:01.543188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:01.543828 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 201/396] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:01.545154 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb2613-f489-4e1a-9756-ad3d6f7faac0 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:01.545684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb2613-f489-4e1a-9756-ad3d6f7faac0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:01.546051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb2613-f489-4e1a-9756-ad3d6f7faac0 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:01.548655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 202/397] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:01.552854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb2613-f489-4e1a-9756-ad3d6f7faac0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:01.660918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 196/398] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 25 21:25:01 2022] PUT /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33/groups/537dbfb30d504705813ec62de052d57c/roles/8595eaa9629b4ec4a628d662402fd25d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:25:01.663634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee429-d65e-464f-a2b2-cc6ed5cbd3e4 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:01.664167 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee429-d65e-464f-a2b2-cc6ed5cbd3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:01.664508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee429-d65e-464f-a2b2-cc6ed5cbd3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:01.733999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb2613-f489-4e1a-9756-ad3d6f7faac0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:01.754928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-f4bee429-d65e-464f-a2b2-cc6ed5cbd3e4 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:01.754928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-f4bee429-d65e-464f-a2b2-cc6ed5cbd3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:01.786571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b92ad-2fd0-4903-b10d-052102c29430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:01.787857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b92ad-2fd0-4903-b10d-052102c29430 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:01.788328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b92ad-2fd0-4903-b10d-052102c29430 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:01.788738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b92ad-2fd0-4903-b10d-052102c29430 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:01.789703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b92ad-2fd0-4903-b10d-052102c29430 None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:01.790198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b92ad-2fd0-4903-b10d-052102c29430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:01.791829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b92ad-2fd0-4903-b10d-052102c29430 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:01.807512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 203/399] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:01.818241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b92ad-2fd0-4903-b10d-052102c29430 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:01.851679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:01.941685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 197/400] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:01.970212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bee429-d65e-464f-a2b2-cc6ed5cbd3e4 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:02.003640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b92ad-2fd0-4903-b10d-052102c29430 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:02.055869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:02.097361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bee429-d65e-464f-a2b2-cc6ed5cbd3e4 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:02.131296 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7757c48-6f5d-4b74-89e7-c37251c0f158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:02.132004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7757c48-6f5d-4b74-89e7-c37251c0f158 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:02.132286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7757c48-6f5d-4b74-89e7-c37251c0f158 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:02.132569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7757c48-6f5d-4b74-89e7-c37251c0f158 None admin] PATH_INFO: `/v3/groups/537dbfb30d504705813ec62de052d57c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:02.134191 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7757c48-6f5d-4b74-89e7-c37251c0f158 None admin] RBAC: Authorizing `identity:get_group(group_id=537dbfb30d504705813ec62de052d57c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:02.135528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823e4ab-4d61-41d9-a83c-150177cdc75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:02.136215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e4ab-4d61-41d9-a83c-150177cdc75b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:02.136499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e4ab-4d61-41d9-a83c-150177cdc75b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:02.136773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e4ab-4d61-41d9-a83c-150177cdc75b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:02.138821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7757c48-6f5d-4b74-89e7-c37251c0f158 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:02.143366 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 204/401] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:25:01 2022] GET /identity/v3/groups/537dbfb30d504705813ec62de052d57c => generated 226 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:02.147573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e9785-e100-49a3-a5f3-d370940dd60e None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:02.148420 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e9785-e100-49a3-a5f3-d370940dd60e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:02.150424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e9785-e100-49a3-a5f3-d370940dd60e None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:02.152646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 205/402] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:02.153754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e9785-e100-49a3-a5f3-d370940dd60e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:02.158247 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823e4ab-4d61-41d9-a83c-150177cdc75b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-c823e4ab-4d61-41d9-a83c-150177cdc75b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:02.165386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:02.166538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:02.167358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:02.167358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:02.167358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:02.167358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:02.167358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:02.167358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:02.167358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:02.167358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:02.167358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:02.167358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:02.167358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:25:02.167358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:02.167358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 198/403] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:25:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:02.168407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d4662-ea17-467c-95da-1f02f48b3b1f None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:02.168407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d4662-ea17-467c-95da-1f02f48b3b1f None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:02.168629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d4662-ea17-467c-95da-1f02f48b3b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:02.196417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-027d4662-ea17-467c-95da-1f02f48b3b1f None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:02.198124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-027d4662-ea17-467c-95da-1f02f48b3b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:02.319142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 199/404] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:02.320336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d4662-ea17-467c-95da-1f02f48b3b1f None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:02.342213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:02.354167 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e9785-e100-49a3-a5f3-d370940dd60e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:02.408666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf2fba-edff-444d-93c6-000fcc441c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:02.409535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf2fba-edff-444d-93c6-000fcc441c68 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:02.409868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf2fba-edff-444d-93c6-000fcc441c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:02.410490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf2fba-edff-444d-93c6-000fcc441c68 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:02.412520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf2fba-edff-444d-93c6-000fcc441c68 None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:02.413965 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf2fba-edff-444d-93c6-000fcc441c68 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:02.416978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 206/405] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:25:02 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:02.417759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf2fba-edff-444d-93c6-000fcc441c68 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:02.423762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:02.477570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d4662-ea17-467c-95da-1f02f48b3b1f None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:02.514007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a1c56-c347-4c2b-b37f-6402d1546801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:02.514737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a1c56-c347-4c2b-b37f-6402d1546801 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:02.515074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a1c56-c347-4c2b-b37f-6402d1546801 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:02.515449 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a1c56-c347-4c2b-b37f-6402d1546801 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:02.516688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a1c56-c347-4c2b-b37f-6402d1546801 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:02.516688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a1c56-c347-4c2b-b37f-6402d1546801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:02.518034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a1c56-c347-4c2b-b37f-6402d1546801 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:02.529103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 200/406] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:02.530635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a1c56-c347-4c2b-b37f-6402d1546801 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:02.563106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf2fba-edff-444d-93c6-000fcc441c68 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:02.603583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673edbf0-7aae-41f2-a81a-d63f849dbdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:02.604340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673edbf0-7aae-41f2-a81a-d63f849dbdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:02.604698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673edbf0-7aae-41f2-a81a-d63f849dbdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:02.605048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673edbf0-7aae-41f2-a81a-d63f849dbdd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:02.618467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673edbf0-7aae-41f2-a81a-d63f849dbdd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-673edbf0-7aae-41f2-a81a-d63f849dbdd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:02.624004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:02.624925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:02.625711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:02.625711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:02.625711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:02.625711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:02.625711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:02.625711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:02.625711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:02.625711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:02.625711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:02.625711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:02.625711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:02.625711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:02.631213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 207/407] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:25:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:02.632339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673edbf0-7aae-41f2-a81a-d63f849dbdd5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:02.653720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:02.666011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a1c56-c347-4c2b-b37f-6402d1546801 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:02.685797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:02.709572 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853b390-8b60-48a5-92a8-6595c971a5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:02.710981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b390-8b60-48a5-92a8-6595c971a5c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:02.711507 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b390-8b60-48a5-92a8-6595c971a5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:02.712115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853b390-8b60-48a5-92a8-6595c971a5c7 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346/groups/537dbfb30d504705813ec62de052d57c/roles/59d226afaffe45f597d70faf647f2f22` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:02.714518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853b390-8b60-48a5-92a8-6595c971a5c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=afcb05e9da4b4207af59800fe02b4346, group_id=537dbfb30d504705813ec62de052d57c, role_id=59d226afaffe45f597d70faf647f2f22)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:02.716391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853b390-8b60-48a5-92a8-6595c971a5c7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:02.754458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673edbf0-7aae-41f2-a81a-d63f849dbdd5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:02.788543 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 201/408] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 25 21:25:02 2022] PUT /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346/groups/537dbfb30d504705813ec62de052d57c/roles/59d226afaffe45f597d70faf647f2f22 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:25:02.790279 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853b390-8b60-48a5-92a8-6595c971a5c7 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:02.802512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fea42c-865a-484a-be6d-0dfbd5f25bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:02.803131 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea42c-865a-484a-be6d-0dfbd5f25bfe None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:02.803418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea42c-865a-484a-be6d-0dfbd5f25bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:02.803701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fea42c-865a-484a-be6d-0dfbd5f25bfe None admin] PATH_INFO: `/v3/groups/537dbfb30d504705813ec62de052d57c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:02.808725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fea42c-865a-484a-be6d-0dfbd5f25bfe None admin] RBAC: Authorizing `identity:get_group(group_id=537dbfb30d504705813ec62de052d57c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:02.810234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fea42c-865a-484a-be6d-0dfbd5f25bfe None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:02.812367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 208/409] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:25:02 2022] GET /identity/v3/groups/537dbfb30d504705813ec62de052d57c => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:02.818446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fea42c-865a-484a-be6d-0dfbd5f25bfe None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:02.920568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853b390-8b60-48a5-92a8-6595c971a5c7 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:02.966341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd40990-f374-4741-90bd-d8914eeb3871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:02.967347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd40990-f374-4741-90bd-d8914eeb3871 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:02.968145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd40990-f374-4741-90bd-d8914eeb3871 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:02.969415 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd40990-f374-4741-90bd-d8914eeb3871 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:02.970510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd40990-f374-4741-90bd-d8914eeb3871 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:02.971009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd40990-f374-4741-90bd-d8914eeb3871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:02.973692 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd40990-f374-4741-90bd-d8914eeb3871 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:02.985381 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 202/410] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:02.994136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd40990-f374-4741-90bd-d8914eeb3871 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:03.047956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:03.072799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fea42c-865a-484a-be6d-0dfbd5f25bfe None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:03.074257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:03.130016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aead62-0f11-481a-98d2-2b752a176f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:03.130961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aead62-0f11-481a-98d2-2b752a176f02 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:03.131243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aead62-0f11-481a-98d2-2b752a176f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:03.131578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aead62-0f11-481a-98d2-2b752a176f02 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:03.136003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aead62-0f11-481a-98d2-2b752a176f02 None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:03.137509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aead62-0f11-481a-98d2-2b752a176f02 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:03.141605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 209/411] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:25:02 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:03.148007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aead62-0f11-481a-98d2-2b752a176f02 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:03.156155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd40990-f374-4741-90bd-d8914eeb3871 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:03.204951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd33f9d-11a4-4a08-86da-98922aa2de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:03.205864 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd33f9d-11a4-4a08-86da-98922aa2de3a None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:03.206157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd33f9d-11a4-4a08-86da-98922aa2de3a None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:03.206439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd33f9d-11a4-4a08-86da-98922aa2de3a None admin] PATH_INFO: `/v3/groups/431297cc0a8248e8a1bccd45be5c3dd1` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:03.208276 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd33f9d-11a4-4a08-86da-98922aa2de3a None admin] RBAC: Authorizing `identity:get_group(group_id=431297cc0a8248e8a1bccd45be5c3dd1)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:03.209735 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd33f9d-11a4-4a08-86da-98922aa2de3a None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:03.211839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 203/412] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:25:02 2022] GET /identity/v3/groups/431297cc0a8248e8a1bccd45be5c3dd1 => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:03.218166 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd33f9d-11a4-4a08-86da-98922aa2de3a None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:03.356633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aead62-0f11-481a-98d2-2b752a176f02 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:03.357025 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd33f9d-11a4-4a08-86da-98922aa2de3a None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:03.368299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:03.399605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c4525-7188-4908-9fc2-0a1d8364503c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:03.399977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12743af2-6c10-452b-a9ca-b914a561209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:03.400513 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12743af2-6c10-452b-a9ca-b914a561209b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:03.400618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4525-7188-4908-9fc2-0a1d8364503c None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:03.400796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12743af2-6c10-452b-a9ca-b914a561209b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:03.400892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4525-7188-4908-9fc2-0a1d8364503c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:03.401067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12743af2-6c10-452b-a9ca-b914a561209b None admin] PATH_INFO: `/v3/projects/e47334e4e95e4979a35529036ec99feb` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:03.401163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c4525-7188-4908-9fc2-0a1d8364503c None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346/groups/537dbfb30d504705813ec62de052d57c/roles/8595eaa9629b4ec4a628d662402fd25d` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:03.402317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12743af2-6c10-452b-a9ca-b914a561209b None admin] RBAC: Authorizing `identity:get_project(project_id=e47334e4e95e4979a35529036ec99feb)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:03.403771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c4525-7188-4908-9fc2-0a1d8364503c None admin] RBAC: Authorizing `identity:create_grant(project_id=afcb05e9da4b4207af59800fe02b4346, group_id=537dbfb30d504705813ec62de052d57c, role_id=8595eaa9629b4ec4a628d662402fd25d)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:03.403893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12743af2-6c10-452b-a9ca-b914a561209b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:03.405441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c4525-7188-4908-9fc2-0a1d8364503c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:03.405750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 204/413] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:25:03 2022] GET /identity/v3/projects/e47334e4e95e4979a35529036ec99feb => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:03.413390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c5512-69ef-4f83-9d36-5c6a4659f2d6 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:03.413622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c5512-69ef-4f83-9d36-5c6a4659f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:03.413891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c5512-69ef-4f83-9d36-5c6a4659f2d6 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:03.419147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 205/414] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:03.419147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c5512-69ef-4f83-9d36-5c6a4659f2d6 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:03.483577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 210/415] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 25 21:25:03 2022] PUT /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346/groups/537dbfb30d504705813ec62de052d57c/roles/8595eaa9629b4ec4a628d662402fd25d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:25:03.484774 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6168df9-0077-49f4-8d58-593d4cef1973 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:03.485061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6168df9-0077-49f4-8d58-593d4cef1973 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:03.485339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6168df9-0077-49f4-8d58-593d4cef1973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:03.537224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d6168df9-0077-49f4-8d58-593d4cef1973 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:03.538743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d6168df9-0077-49f4-8d58-593d4cef1973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:03.539425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c5512-69ef-4f83-9d36-5c6a4659f2d6 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:03.554886 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:03.589386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d0a0e-6e08-45e7-8764-64538b62f13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:03.590093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d0a0e-6e08-45e7-8764-64538b62f13d None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:03.590418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d0a0e-6e08-45e7-8764-64538b62f13d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:03.590628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d0a0e-6e08-45e7-8764-64538b62f13d None admin] PATH_INFO: `/v3/projects/e47334e4e95e4979a35529036ec99feb/groups/431297cc0a8248e8a1bccd45be5c3dd1/roles/11da9ce3f79148679dbde9eb2c568e55` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:03.593385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d0a0e-6e08-45e7-8764-64538b62f13d None admin] RBAC: Authorizing `identity:create_grant(project_id=e47334e4e95e4979a35529036ec99feb, group_id=431297cc0a8248e8a1bccd45be5c3dd1, role_id=11da9ce3f79148679dbde9eb2c568e55)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:03.595198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d0a0e-6e08-45e7-8764-64538b62f13d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:03.653280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 211/416] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:03.685167 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6168df9-0077-49f4-8d58-593d4cef1973 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:03.699198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 206/417] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 25 21:25:03 2022] PUT /identity/v3/projects/e47334e4e95e4979a35529036ec99feb/groups/431297cc0a8248e8a1bccd45be5c3dd1/roles/11da9ce3f79148679dbde9eb2c568e55 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:25:03.817584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6168df9-0077-49f4-8d58-593d4cef1973 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:03.860621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a271d-163f-4cbf-bb97-1947c57c44ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:03.861279 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a271d-163f-4cbf-bb97-1947c57c44ed None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:03.861558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a271d-163f-4cbf-bb97-1947c57c44ed None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:03.861832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a271d-163f-4cbf-bb97-1947c57c44ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:03.877545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a271d-163f-4cbf-bb97-1947c57c44ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-a57a271d-163f-4cbf-bb97-1947c57c44ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:03.883143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:03.884110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:03.884900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:03.884900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:03.884900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:03.884900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:03.884900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:03.884900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:03.884900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:03.884900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:03.884900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:03.884900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:03.884900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:25:03.884900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:03.887202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 212/418] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:03.893377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d0a0e-6e08-45e7-8764-64538b62f13d None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:03.944385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:04.046624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d0a0e-6e08-45e7-8764-64538b62f13d None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:04.083158 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644b43b-6387-4797-b49b-693686225bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:04.083690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b43b-6387-4797-b49b-693686225bea None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:04.084007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b43b-6387-4797-b49b-693686225bea None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:04.084282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644b43b-6387-4797-b49b-693686225bea None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:04.085006 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644b43b-6387-4797-b49b-693686225bea None admin] RBAC: Adding query filter params (name=member) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:04.085311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644b43b-6387-4797-b49b-693686225bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:04.086673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644b43b-6387-4797-b49b-693686225bea None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:04.095440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 207/419] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:25:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:04.101660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a271d-163f-4cbf-bb97-1947c57c44ed None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:04.106270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:04.119856 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5da79b-f7de-4a08-a59c-62f23872b469 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:04.120168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5da79b-f7de-4a08-a59c-62f23872b469 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:04.120416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5da79b-f7de-4a08-a59c-62f23872b469 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:04.122034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 208/420] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:04.132881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce05fe2-030c-4f8a-bdc8-8a1f55f04f71 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:04.133174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce05fe2-030c-4f8a-bdc8-8a1f55f04f71 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:04.133466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce05fe2-030c-4f8a-bdc8-8a1f55f04f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:04.166010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-6ce05fe2-030c-4f8a-bdc8-8a1f55f04f71 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:04.166010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-6ce05fe2-030c-4f8a-bdc8-8a1f55f04f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:04.245345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 209/421] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:04.274952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a271d-163f-4cbf-bb97-1947c57c44ed None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:04.280926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce05fe2-030c-4f8a-bdc8-8a1f55f04f71 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:04.319554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:04.372555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b200594-51ec-4152-8c76-649b64f0e8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:04.373107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b200594-51ec-4152-8c76-649b64f0e8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:04.373389 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b200594-51ec-4152-8c76-649b64f0e8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:04.373662 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b200594-51ec-4152-8c76-649b64f0e8b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:04.405554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce05fe2-030c-4f8a-bdc8-8a1f55f04f71 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:04.447364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0ae66-153f-40fe-a323-dddf4d683b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:04.448441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0ae66-153f-40fe-a323-dddf4d683b45 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:04.448728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0ae66-153f-40fe-a323-dddf4d683b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:04.449007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0ae66-153f-40fe-a323-dddf4d683b45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:04.461442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0ae66-153f-40fe-a323-dddf4d683b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-c8d0ae66-153f-40fe-a323-dddf4d683b45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:04.467046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:04.467945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:04.468759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:04.468759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:04.468759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:04.468759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:04.468759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:04.468759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:04.468759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:04.468759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:04.468759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:04.468759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:04.468759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:25:04.468759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:04.468759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 210/422] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:25:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:04.477746 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0ae66-153f-40fe-a323-dddf4d683b45 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:04.522466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b200594-51ec-4152-8c76-649b64f0e8b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:04.523978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b200594-51ec-4152-8c76-649b64f0e8b7 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:04.526822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:04.642727 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 213/423] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:25:04.651476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b200594-51ec-4152-8c76-649b64f0e8b7 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:04.684527 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:04.711128 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0ae66-153f-40fe-a323-dddf4d683b45 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:04.756721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5e19b-e5ce-4771-84ad-3f88959f8da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:04.757747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5e19b-e5ce-4771-84ad-3f88959f8da6 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:04.759553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5e19b-e5ce-4771-84ad-3f88959f8da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:04.760044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5e19b-e5ce-4771-84ad-3f88959f8da6 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:04.761984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5e19b-e5ce-4771-84ad-3f88959f8da6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:04.762976 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5e19b-e5ce-4771-84ad-3f88959f8da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:04.764550 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5e19b-e5ce-4771-84ad-3f88959f8da6 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:04.783494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 211/424] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:04.789928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5e19b-e5ce-4771-84ad-3f88959f8da6 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:04.839669 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b200594-51ec-4152-8c76-649b64f0e8b7 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:04.856096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:04.879173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffeb74c-67c4-43bb-a3ee-238fa4db85c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:04.880278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffeb74c-67c4-43bb-a3ee-238fa4db85c8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:04.880909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffeb74c-67c4-43bb-a3ee-238fa4db85c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:04.881379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffeb74c-67c4-43bb-a3ee-238fa4db85c8 None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:04.883095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffeb74c-67c4-43bb-a3ee-238fa4db85c8 None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:04.885263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffeb74c-67c4-43bb-a3ee-238fa4db85c8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:04.887624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 214/425] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:25:04 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:04.894192 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffeb74c-67c4-43bb-a3ee-238fa4db85c8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:05.011269 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffeb74c-67c4-43bb-a3ee-238fa4db85c8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:05.051994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845586a7-eee1-4a1d-a8f5-4bf0efa8af6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:05.052951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845586a7-eee1-4a1d-a8f5-4bf0efa8af6d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:05.053415 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845586a7-eee1-4a1d-a8f5-4bf0efa8af6d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:05.054134 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845586a7-eee1-4a1d-a8f5-4bf0efa8af6d None admin] PATH_INFO: `/v3/groups/537dbfb30d504705813ec62de052d57c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:05.056542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845586a7-eee1-4a1d-a8f5-4bf0efa8af6d None admin] RBAC: Authorizing `identity:get_group(group_id=537dbfb30d504705813ec62de052d57c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:05.058204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845586a7-eee1-4a1d-a8f5-4bf0efa8af6d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:05.060351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 215/426] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:25:04 2022] GET /identity/v3/groups/537dbfb30d504705813ec62de052d57c => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:05.067370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845586a7-eee1-4a1d-a8f5-4bf0efa8af6d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:05.120269 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:05.146556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5e19b-e5ce-4771-84ad-3f88959f8da6 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:05.181074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845586a7-eee1-4a1d-a8f5-4bf0efa8af6d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:05.222913 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8188ad-92e4-4786-ae1f-5b53090b1d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:05.223932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8188ad-92e4-4786-ae1f-5b53090b1d88 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:05.224626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8188ad-92e4-4786-ae1f-5b53090b1d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:05.225102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8188ad-92e4-4786-ae1f-5b53090b1d88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:05.226122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8188ad-92e4-4786-ae1f-5b53090b1d88 None admin] RBAC: Adding query filter params (group.id=537dbfb30d504705813ec62de052d57c, role.id=59d226afaffe45f597d70faf647f2f22, scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:05.226622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8188ad-92e4-4786-ae1f-5b53090b1d88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:05.228255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8188ad-92e4-4786-ae1f-5b53090b1d88 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:05.228412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d84ab-8da2-4d4d-8317-dc28b578dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:05.229049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d84ab-8da2-4d4d-8317-dc28b578dc46 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:05.229334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d84ab-8da2-4d4d-8317-dc28b578dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:05.229613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d84ab-8da2-4d4d-8317-dc28b578dc46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:05.236162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 216/427] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 21:25:05 2022] GET /identity/v3/role_assignments?group.id=537dbfb30d504705813ec62de052d57c&scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33&role.id=59d226afaffe45f597d70faf647f2f22 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:05.283688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:05.315660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043d5bd-4f95-4677-944a-85850a5796c9 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:05.317164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043d5bd-4f95-4677-944a-85850a5796c9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:05.317656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043d5bd-4f95-4677-944a-85850a5796c9 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:05.320501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 217/428] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:25:05.325575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cc08e-9247-4f9d-ae1e-7f11a960a187 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:05.326157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cc08e-9247-4f9d-ae1e-7f11a960a187 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:05.326667 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cc08e-9247-4f9d-ae1e-7f11a960a187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:05.349591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-117cc08e-9247-4f9d-ae1e-7f11a960a187 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:05.351196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-117cc08e-9247-4f9d-ae1e-7f11a960a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:05.408985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d84ab-8da2-4d4d-8317-dc28b578dc46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:05.410878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d84ab-8da2-4d4d-8317-dc28b578dc46 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:05.433350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 218/429] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:05.463798 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cc08e-9247-4f9d-ae1e-7f11a960a187 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:05.508374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:05.539466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 212/430] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:25:05.542240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d84ab-8da2-4d4d-8317-dc28b578dc46 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:05.585008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cc08e-9247-4f9d-ae1e-7f11a960a187 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:05.598220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:05.624399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ec51d-9915-4000-b332-c62441c582e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:05.625401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ec51d-9915-4000-b332-c62441c582e4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:05.625889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ec51d-9915-4000-b332-c62441c582e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:05.626364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ec51d-9915-4000-b332-c62441c582e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:05.638792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ec51d-9915-4000-b332-c62441c582e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-d60ec51d-9915-4000-b332-c62441c582e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:05.644142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:05.645011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:05.645795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:05.645795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:05.645795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:05.645795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:05.645795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:05.645795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:05.645795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:05.645795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:05.645795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:05.645795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:05.645795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 21:25:05.645795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:05.648509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 219/431] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:05.654395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ec51d-9915-4000-b332-c62441c582e4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:05.654563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d84ab-8da2-4d4d-8317-dc28b578dc46 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:05.711883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847e0c6-ab74-4895-9972-ab163cf89eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:05.712555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847e0c6-ab74-4895-9972-ab163cf89eff None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:05.712837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847e0c6-ab74-4895-9972-ab163cf89eff None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:05.715914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847e0c6-ab74-4895-9972-ab163cf89eff None admin] PATH_INFO: `/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:05.717985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847e0c6-ab74-4895-9972-ab163cf89eff None admin] RBAC: Authorizing `identity:get_project(project_id=ee4e6637d7984dabbbe2d7d731b48a33)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:05.721400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847e0c6-ab74-4895-9972-ab163cf89eff None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:05.731945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 213/432] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:25:05 2022] GET /identity/v3/projects/ee4e6637d7984dabbbe2d7d731b48a33 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:05.739626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847e0c6-ab74-4895-9972-ab163cf89eff None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:05.845903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:05.855971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ec51d-9915-4000-b332-c62441c582e4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:05.870211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847e0c6-ab74-4895-9972-ab163cf89eff None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:05.888782 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:05.910297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac9e66-cdc7-4c39-8884-656c8f36d2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:05.913311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac9e66-cdc7-4c39-8884-656c8f36d2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:05.913833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac9e66-cdc7-4c39-8884-656c8f36d2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:05.914361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac9e66-cdc7-4c39-8884-656c8f36d2a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:05.916324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac9e66-cdc7-4c39-8884-656c8f36d2a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:05.917586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac9e66-cdc7-4c39-8884-656c8f36d2a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:05.919512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac9e66-cdc7-4c39-8884-656c8f36d2a4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:05.931872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58395550-0a1e-472d-a246-2526c7582f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:05.934769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58395550-0a1e-472d-a246-2526c7582f63 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:05.935270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58395550-0a1e-472d-a246-2526c7582f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:05.935767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58395550-0a1e-472d-a246-2526c7582f63 None admin] PATH_INFO: `/v3/groups/537dbfb30d504705813ec62de052d57c` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:05.937290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58395550-0a1e-472d-a246-2526c7582f63 None admin] RBAC: Authorizing `identity:get_group(group_id=537dbfb30d504705813ec62de052d57c)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:05.938990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58395550-0a1e-472d-a246-2526c7582f63 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:05.941898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 214/433] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:25:05 2022] GET /identity/v3/groups/537dbfb30d504705813ec62de052d57c => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:05.950187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 220/434] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:25:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:05.951492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58395550-0a1e-472d-a246-2526c7582f63 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:05.952204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac9e66-cdc7-4c39-8884-656c8f36d2a4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:06.099194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58395550-0a1e-472d-a246-2526c7582f63 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:06.122987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac9e66-cdc7-4c39-8884-656c8f36d2a4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:06.141422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3857da-c220-465b-81f5-db74361cbd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:06.142109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3857da-c220-465b-81f5-db74361cbd86 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:06.142394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3857da-c220-465b-81f5-db74361cbd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:06.142776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3857da-c220-465b-81f5-db74361cbd86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:06.143578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3857da-c220-465b-81f5-db74361cbd86 None admin] RBAC: Adding query filter params (group.id=537dbfb30d504705813ec62de052d57c, role.id=8595eaa9629b4ec4a628d662402fd25d, scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:06.143914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3857da-c220-465b-81f5-db74361cbd86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:06.145915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3857da-c220-465b-81f5-db74361cbd86 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:06.152230 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 215/435] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 21:25:05 2022] GET /identity/v3/role_assignments?group.id=537dbfb30d504705813ec62de052d57c&scope.project.id=ee4e6637d7984dabbbe2d7d731b48a33&role.id=8595eaa9629b4ec4a628d662402fd25d => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:06.153775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3a21-1946-48ac-8153-ca1ef73eb860 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:06.154065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3a21-1946-48ac-8153-ca1ef73eb860 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:06.154343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3a21-1946-48ac-8153-ca1ef73eb860 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:06.155550 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 216/436] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:06.165314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31340847-6a1f-4432-a470-0f82b04a006d None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:06.165838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31340847-6a1f-4432-a470-0f82b04a006d None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:06.166327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31340847-6a1f-4432-a470-0f82b04a006d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:06.167247 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b638b-a6e4-4b37-9dc2-289a0fe65b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:06.167944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b638b-a6e4-4b37-9dc2-289a0fe65b87 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:06.168235 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b638b-a6e4-4b37-9dc2-289a0fe65b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:06.168516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b638b-a6e4-4b37-9dc2-289a0fe65b87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:06.204290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-31340847-6a1f-4432-a470-0f82b04a006d None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:06.205519 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-31340847-6a1f-4432-a470-0f82b04a006d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:06.211638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:06.263990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:06.266205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b638b-a6e4-4b37-9dc2-289a0fe65b87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:06.267691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b638b-a6e4-4b37-9dc2-289a0fe65b87 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:06.290917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 217/437] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:06.293426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6426c-aff0-4de8-b2c9-c5c4eb765688 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:06.294048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6426c-aff0-4de8-b2c9-c5c4eb765688 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:06.294501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6426c-aff0-4de8-b2c9-c5c4eb765688 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:06.301774 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 218/438] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:06.303311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d7c6-e8ab-4a37-b11c-c4f934cc5c23 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:06.303883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d7c6-e8ab-4a37-b11c-c4f934cc5c23 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:06.305581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d7c6-e8ab-4a37-b11c-c4f934cc5c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:06.324511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-b2e0d7c6-e8ab-4a37-b11c-c4f934cc5c23 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:06.325715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-b2e0d7c6-e8ab-4a37-b11c-c4f934cc5c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:06.401238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 221/439] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:25:06.402012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b638b-a6e4-4b37-9dc2-289a0fe65b87 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:06.402611 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 219/440] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:06.406850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0d7c6-e8ab-4a37-b11c-c4f934cc5c23 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:06.468459 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:06.521548 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b638b-a6e4-4b37-9dc2-289a0fe65b87 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:06.538517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0d7c6-e8ab-4a37-b11c-c4f934cc5c23 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:06.550935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:06.562848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b3f5b-382e-4a4c-b3ad-f5f267bb9dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:06.563493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3f5b-382e-4a4c-b3ad-f5f267bb9dcc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:06.563844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3f5b-382e-4a4c-b3ad-f5f267bb9dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:06.564127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3f5b-382e-4a4c-b3ad-f5f267bb9dcc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:06.573643 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5943fca-94d0-46dd-8363-3cbf82ed8cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:06.574282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5943fca-94d0-46dd-8363-3cbf82ed8cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:06.582934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b3f5b-382e-4a4c-b3ad-f5f267bb9dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:06.583074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5943fca-94d0-46dd-8363-3cbf82ed8cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:06.583074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5943fca-94d0-46dd-8363-3cbf82ed8cb7 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:06.583074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5943fca-94d0-46dd-8363-3cbf82ed8cb7 None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:06.583074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5943fca-94d0-46dd-8363-3cbf82ed8cb7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:06.583074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 220/441] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:25:06 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ba4b3f5b-382e-4a4c-b3ad-f5f267bb9dcc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:06.583392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:06.584277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:06.585063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:06.585063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:06.585063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:06.585063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:06.585063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:06.585063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:06.585063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:06.585063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:06.585063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:06.585063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:06.585063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:25:06.585063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:06.585655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5943fca-94d0-46dd-8363-3cbf82ed8cb7 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:06.585735 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 222/442] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:06.585735 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b3f5b-382e-4a4c-b3ad-f5f267bb9dcc None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:06.681153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5943fca-94d0-46dd-8363-3cbf82ed8cb7 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:06.685775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b3f5b-382e-4a4c-b3ad-f5f267bb9dcc None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:06.702776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:06.714795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b813d2-9897-4fb7-9c8f-b3ad4447e7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:06.715528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b813d2-9897-4fb7-9c8f-b3ad4447e7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:06.715883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b813d2-9897-4fb7-9c8f-b3ad4447e7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:06.716163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b813d2-9897-4fb7-9c8f-b3ad4447e7c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:06.720750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c697c-9df8-4a5b-bf67-2b99d5180593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:06.721528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c697c-9df8-4a5b-bf67-2b99d5180593 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:06.721806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c697c-9df8-4a5b-bf67-2b99d5180593 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:06.722078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c697c-9df8-4a5b-bf67-2b99d5180593 None admin] PATH_INFO: `/v3/groups/537dbfb30d504705813ec62de052d57c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:06.723859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c697c-9df8-4a5b-bf67-2b99d5180593 None admin] RBAC: Authorizing `identity:get_group(group_id=537dbfb30d504705813ec62de052d57c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:06.725334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c697c-9df8-4a5b-bf67-2b99d5180593 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:06.727223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b813d2-9897-4fb7-9c8f-b3ad4447e7c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:06.727423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 223/443] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:25:06 2022] GET /identity/v3/groups/537dbfb30d504705813ec62de052d57c => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:06.728311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c697c-9df8-4a5b-bf67-2b99d5180593 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-f1b813d2-9897-4fb7-9c8f-b3ad4447e7c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:06.732700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:06.733570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:06.734357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:06.734357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:06.734357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:06.734357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:06.734357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:06.734357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:06.734357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:06.734357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:06.734357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:06.734357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:06.734357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:06.734357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:06.734357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 221/444] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:25:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:06.735539 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b813d2-9897-4fb7-9c8f-b3ad4447e7c7 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:06.774878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:06.832144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c697c-9df8-4a5b-bf67-2b99d5180593 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:06.834309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b813d2-9897-4fb7-9c8f-b3ad4447e7c7 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:06.866656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297149e7-ac7e-4366-bdf0-68306bd43aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:06.867194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872f4ae-98fd-4591-9908-f490f1d2c82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:06.867302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297149e7-ac7e-4366-bdf0-68306bd43aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:06.867547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297149e7-ac7e-4366-bdf0-68306bd43aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:06.867652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872f4ae-98fd-4591-9908-f490f1d2c82c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:06.867854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297149e7-ac7e-4366-bdf0-68306bd43aa7 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:06.867969 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872f4ae-98fd-4591-9908-f490f1d2c82c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:06.868210 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872f4ae-98fd-4591-9908-f490f1d2c82c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:06.868576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297149e7-ac7e-4366-bdf0-68306bd43aa7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:06.868887 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297149e7-ac7e-4366-bdf0-68306bd43aa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:06.869018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872f4ae-98fd-4591-9908-f490f1d2c82c None admin] RBAC: Adding query filter params (group.id=537dbfb30d504705813ec62de052d57c, role.id=59d226afaffe45f597d70faf647f2f22, scope.project.id=afcb05e9da4b4207af59800fe02b4346) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:06.869326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872f4ae-98fd-4591-9908-f490f1d2c82c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:06.870287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297149e7-ac7e-4366-bdf0-68306bd43aa7 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:06.870721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872f4ae-98fd-4591-9908-f490f1d2c82c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:06.876756 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 222/445] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 21:25:06 2022] GET /identity/v3/role_assignments?group.id=537dbfb30d504705813ec62de052d57c&scope.project.id=afcb05e9da4b4207af59800fe02b4346&role.id=59d226afaffe45f597d70faf647f2f22 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:06.877518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872f4ae-98fd-4591-9908-f490f1d2c82c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:06.878126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 224/446] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:06.884645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297149e7-ac7e-4366-bdf0-68306bd43aa7 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:06.942895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:06.997296 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872f4ae-98fd-4591-9908-f490f1d2c82c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:06.999187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:07.013606 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297149e7-ac7e-4366-bdf0-68306bd43aa7 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:07.038304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cbffd-df78-4ae9-b7cd-0327eaf12502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:07.039160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cbffd-df78-4ae9-b7cd-0327eaf12502 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:07.039776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cbffd-df78-4ae9-b7cd-0327eaf12502 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:07.039776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cbffd-df78-4ae9-b7cd-0327eaf12502 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:07.040470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cbffd-df78-4ae9-b7cd-0327eaf12502 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:07.040777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cbffd-df78-4ae9-b7cd-0327eaf12502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:07.042165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cbffd-df78-4ae9-b7cd-0327eaf12502 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:07.051467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 223/447] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:07.056661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd921c-408a-44e6-8612-219f2f93cfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:07.057298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd921c-408a-44e6-8612-219f2f93cfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:07.057584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd921c-408a-44e6-8612-219f2f93cfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:07.057864 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd921c-408a-44e6-8612-219f2f93cfe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:07.057999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cbffd-df78-4ae9-b7cd-0327eaf12502 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:07.146311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd921c-408a-44e6-8612-219f2f93cfe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:07.147842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd921c-408a-44e6-8612-219f2f93cfe6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:07.179905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cbffd-df78-4ae9-b7cd-0327eaf12502 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:07.204736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:07.218844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125cbbe-a325-494c-a70c-abfcc60b684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:07.219472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125cbbe-a325-494c-a70c-abfcc60b684b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:07.225148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125cbbe-a325-494c-a70c-abfcc60b684b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:07.225148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125cbbe-a325-494c-a70c-abfcc60b684b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:07.256608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:07.265444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 225/448] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:25:07.271340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd921c-408a-44e6-8612-219f2f93cfe6 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:07.293423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125cbbe-a325-494c-a70c-abfcc60b684b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:07.295287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125cbbe-a325-494c-a70c-abfcc60b684b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:07.368321 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd921c-408a-44e6-8612-219f2f93cfe6 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:07.393108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 224/449] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 21:25:07.398744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125cbbe-a325-494c-a70c-abfcc60b684b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:07.403431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5291d0-af22-4496-98ff-ffd34a40b8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:07.404130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5291d0-af22-4496-98ff-ffd34a40b8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:07.404412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5291d0-af22-4496-98ff-ffd34a40b8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:07.404685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5291d0-af22-4496-98ff-ffd34a40b8b0 None admin] PATH_INFO: `/v3/projects/afcb05e9da4b4207af59800fe02b4346` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:07.405871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5291d0-af22-4496-98ff-ffd34a40b8b0 None admin] RBAC: Authorizing `identity:get_project(project_id=afcb05e9da4b4207af59800fe02b4346)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:07.407304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5291d0-af22-4496-98ff-ffd34a40b8b0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:07.408990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 226/450] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:25:07 2022] GET /identity/v3/projects/afcb05e9da4b4207af59800fe02b4346 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:07.414917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5291d0-af22-4496-98ff-ffd34a40b8b0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:07.430323 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:07.461403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:07.498865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125cbbe-a325-494c-a70c-abfcc60b684b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:07.515827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5291d0-af22-4496-98ff-ffd34a40b8b0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:07.532127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee939a73-94d9-4914-979e-ab7f30e62b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:07.532771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee939a73-94d9-4914-979e-ab7f30e62b84 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:07.533059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee939a73-94d9-4914-979e-ab7f30e62b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:07.533333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee939a73-94d9-4914-979e-ab7f30e62b84 None admin] PATH_INFO: `/v3/projects/e47334e4e95e4979a35529036ec99feb` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:07.534523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee939a73-94d9-4914-979e-ab7f30e62b84 None admin] RBAC: Authorizing `identity:get_project(project_id=e47334e4e95e4979a35529036ec99feb)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:07.536013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee939a73-94d9-4914-979e-ab7f30e62b84 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:07.537906 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 225/451] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:25:07 2022] GET /identity/v3/projects/e47334e4e95e4979a35529036ec99feb => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:07.543443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee939a73-94d9-4914-979e-ab7f30e62b84 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:07.549381 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f854bf-3a34-4e0f-bc77-7a800b406580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:07.554441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f854bf-3a34-4e0f-bc77-7a800b406580 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:07.554441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f854bf-3a34-4e0f-bc77-7a800b406580 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:07.554441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f854bf-3a34-4e0f-bc77-7a800b406580 None admin] PATH_INFO: `/v3/groups/537dbfb30d504705813ec62de052d57c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:07.554441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f854bf-3a34-4e0f-bc77-7a800b406580 None admin] RBAC: Authorizing `identity:get_group(group_id=537dbfb30d504705813ec62de052d57c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:07.554441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f854bf-3a34-4e0f-bc77-7a800b406580 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:07.555840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 227/452] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:25:07 2022] GET /identity/v3/groups/537dbfb30d504705813ec62de052d57c => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:07.561633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f854bf-3a34-4e0f-bc77-7a800b406580 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:07.645001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:07.646108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee939a73-94d9-4914-979e-ab7f30e62b84 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:07.663411 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f854bf-3a34-4e0f-bc77-7a800b406580 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:07.675140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:07.681056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67e035-3304-4b34-8406-c354c3ae61a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:07.681699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67e035-3304-4b34-8406-c354c3ae61a8 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:07.682001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67e035-3304-4b34-8406-c354c3ae61a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:07.682280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67e035-3304-4b34-8406-c354c3ae61a8 None admin] PATH_INFO: `/v3/groups/431297cc0a8248e8a1bccd45be5c3dd1` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:07.683440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67e035-3304-4b34-8406-c354c3ae61a8 None admin] RBAC: Authorizing `identity:get_group(group_id=431297cc0a8248e8a1bccd45be5c3dd1)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:07.684912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67e035-3304-4b34-8406-c354c3ae61a8 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:07.686513 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 226/453] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 25 21:25:07 2022] GET /identity/v3/groups/431297cc0a8248e8a1bccd45be5c3dd1 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:07.693156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67e035-3304-4b34-8406-c354c3ae61a8 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:07.702723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64e589-a31a-44f4-90b7-26c1e3cae56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:07.703334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64e589-a31a-44f4-90b7-26c1e3cae56d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:07.703612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64e589-a31a-44f4-90b7-26c1e3cae56d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:07.704020 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64e589-a31a-44f4-90b7-26c1e3cae56d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:07.705850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64e589-a31a-44f4-90b7-26c1e3cae56d None admin] RBAC: Adding query filter params (group.id=537dbfb30d504705813ec62de052d57c, role.id=8595eaa9629b4ec4a628d662402fd25d, scope.project.id=afcb05e9da4b4207af59800fe02b4346) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:07.705850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64e589-a31a-44f4-90b7-26c1e3cae56d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:07.707536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64e589-a31a-44f4-90b7-26c1e3cae56d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:07.713487 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 228/454] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 21:25:07 2022] GET /identity/v3/role_assignments?group.id=537dbfb30d504705813ec62de052d57c&scope.project.id=afcb05e9da4b4207af59800fe02b4346&role.id=8595eaa9629b4ec4a628d662402fd25d => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:07.799927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67e035-3304-4b34-8406-c354c3ae61a8 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:07.835754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7fa82-1caa-49a1-913d-e55af0f59a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:07.836407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7fa82-1caa-49a1-913d-e55af0f59a92 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:07.836688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7fa82-1caa-49a1-913d-e55af0f59a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:07.836966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7fa82-1caa-49a1-913d-e55af0f59a92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:07.837772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7fa82-1caa-49a1-913d-e55af0f59a92 None admin] RBAC: Adding query filter params (group.id=431297cc0a8248e8a1bccd45be5c3dd1, role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=e47334e4e95e4979a35529036ec99feb) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:07.838086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7fa82-1caa-49a1-913d-e55af0f59a92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:07.839541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7fa82-1caa-49a1-913d-e55af0f59a92 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:07.845916 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 227/455] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 25 21:25:07 2022] GET /identity/v3/role_assignments?group.id=431297cc0a8248e8a1bccd45be5c3dd1&scope.project.id=e47334e4e95e4979a35529036ec99feb&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:10.333832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9979f-5bcc-46d0-94de-848729ded9d1 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:10.334377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9979f-5bcc-46d0-94de-848729ded9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:10.334377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9979f-5bcc-46d0-94de-848729ded9d1 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:10.336042 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 229/456] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:10.341065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c8ef5-6dc9-4c6f-80c5-aaf50a9d6d56 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:10.341447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c8ef5-6dc9-4c6f-80c5-aaf50a9d6d56 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:10.341609 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c8ef5-6dc9-4c6f-80c5-aaf50a9d6d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:10.368729 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-590c8ef5-6dc9-4c6f-80c5-aaf50a9d6d56 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:10.369941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-590c8ef5-6dc9-4c6f-80c5-aaf50a9d6d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:10.446496 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:10.457406 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 228/457] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:10.505349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9979f-5bcc-46d0-94de-848729ded9d1 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:10.639101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dccb77-3c00-4a55-b592-03cff00e788c None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:10.639655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dccb77-3c00-4a55-b592-03cff00e788c None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:10.640169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dccb77-3c00-4a55-b592-03cff00e788c None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:10.641991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 229/458] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:10.643226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9979f-5bcc-46d0-94de-848729ded9d1 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:10.658034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e7d66-e6bd-46bb-ace9-8956be08eb45 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:10.658631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e7d66-e6bd-46bb-ace9-8956be08eb45 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:10.659104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e7d66-e6bd-46bb-ace9-8956be08eb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:10.691321 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47977662-7219-421f-8a94-a44694723ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:10.692394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47977662-7219-421f-8a94-a44694723ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:10.692905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47977662-7219-421f-8a94-a44694723ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:10.693379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47977662-7219-421f-8a94-a44694723ec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:10.705598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-fc1e7d66-e6bd-46bb-ace9-8956be08eb45 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:10.706873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-fc1e7d66-e6bd-46bb-ace9-8956be08eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:10.718961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47977662-7219-421f-8a94-a44694723ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:10.720494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47977662-7219-421f-8a94-a44694723ec8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:10.732085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-47977662-7219-421f-8a94-a44694723ec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:10.744791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:10.745709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:10.746546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:10.746546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:10.746546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:10.746546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:10.751941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 230/459] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:10.761157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47977662-7219-421f-8a94-a44694723ec8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:10.825364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 230/460] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:25:10.826709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c2aaf-a866-4e1e-b39c-f3918499e027 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:10.827001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c2aaf-a866-4e1e-b39c-f3918499e027 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:10.827280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c2aaf-a866-4e1e-b39c-f3918499e027 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:10.828667 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 231/461] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:10.833882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ed4e3-a5cf-477c-8a59-8428ccfff52d None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:10.834173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ed4e3-a5cf-477c-8a59-8428ccfff52d None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:10.834453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ed4e3-a5cf-477c-8a59-8428ccfff52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:10.862587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-5f1ed4e3-a5cf-477c-8a59-8428ccfff52d None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:10.867762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-5f1ed4e3-a5cf-477c-8a59-8428ccfff52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:10.924476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47977662-7219-421f-8a94-a44694723ec8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:10.957704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 232/462] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:10.959933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ed4e3-a5cf-477c-8a59-8428ccfff52d None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:10.980603 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdfe8a-a648-45a4-a8af-6677e62cc182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:10.981230 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdfe8a-a648-45a4-a8af-6677e62cc182 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:10.981514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdfe8a-a648-45a4-a8af-6677e62cc182 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:10.981787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdfe8a-a648-45a4-a8af-6677e62cc182 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:10.982492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdfe8a-a648-45a4-a8af-6677e62cc182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:10.983987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdfe8a-a648-45a4-a8af-6677e62cc182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:10.985522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdfe8a-a648-45a4-a8af-6677e62cc182 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:11.006650 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 231/463] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:11.007511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdfe8a-a648-45a4-a8af-6677e62cc182 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:11.035344 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:11.071811 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:11.080918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ed4e3-a5cf-477c-8a59-8428ccfff52d None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:11.117240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3f25c-3644-4890-aa57-1e6339474021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:11.117739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdfe8a-a648-45a4-a8af-6677e62cc182 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:11.117922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3f25c-3644-4890-aa57-1e6339474021 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:11.118167 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3f25c-3644-4890-aa57-1e6339474021 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:11.118458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3f25c-3644-4890-aa57-1e6339474021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:11.130218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3f25c-3644-4890-aa57-1e6339474021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:11.131677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3f25c-3644-4890-aa57-1e6339474021 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-afc3f25c-3644-4890-aa57-1e6339474021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:11.148349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:11.149241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:11.150078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:11.150078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:11.150078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:11.150078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:11.154265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 233/464] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:11.155111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3f25c-3644-4890-aa57-1e6339474021 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:11.157400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391138a-2e45-4112-b318-d2b123ddbaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:11.158217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391138a-2e45-4112-b318-d2b123ddbaa2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:11.158514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391138a-2e45-4112-b318-d2b123ddbaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:11.158792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391138a-2e45-4112-b318-d2b123ddbaa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:11.172801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391138a-2e45-4112-b318-d2b123ddbaa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:11.174275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391138a-2e45-4112-b318-d2b123ddbaa2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-9391138a-2e45-4112-b318-d2b123ddbaa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:11.189243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:11.190254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:11.191964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:11.191964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:11.191964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:11.191964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:11.191964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 232/465] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:11.192223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dec87-0a77-42ff-bbf2-391e5019e3ea None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:11.192767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dec87-0a77-42ff-bbf2-391e5019e3ea None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:11.192767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dec87-0a77-42ff-bbf2-391e5019e3ea None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:11.194171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 233/466] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:11.198590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dec87-0a77-42ff-bbf2-391e5019e3ea None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:11.276529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3f25c-3644-4890-aa57-1e6339474021 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:11.283423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:11.312056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dec87-0a77-42ff-bbf2-391e5019e3ea None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:11.312393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b16d59-58bb-4c18-abd1-17e4bb652737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:11.313034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b16d59-58bb-4c18-abd1-17e4bb652737 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:11.313318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b16d59-58bb-4c18-abd1-17e4bb652737 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:11.313587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b16d59-58bb-4c18-abd1-17e4bb652737 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:11.314271 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b16d59-58bb-4c18-abd1-17e4bb652737 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:11.316441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b16d59-58bb-4c18-abd1-17e4bb652737 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:11.324612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:11.348487 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c44a6-133f-4732-ae04-1d50fda2c783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:11.349076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c44a6-133f-4732-ae04-1d50fda2c783 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:11.349418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c44a6-133f-4732-ae04-1d50fda2c783 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:11.349695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c44a6-133f-4732-ae04-1d50fda2c783 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:11.350391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c44a6-133f-4732-ae04-1d50fda2c783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:11.350698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c44a6-133f-4732-ae04-1d50fda2c783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:11.352113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c44a6-133f-4732-ae04-1d50fda2c783 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:11.365276 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 234/467] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:11.366093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c44a6-133f-4732-ae04-1d50fda2c783 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:11.408251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 234/468] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:25:11 2022] POST /identity/v3/users => generated 246 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:25:11.410656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f6fa6-dd78-4298-b090-50501aa1cba3 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:11.410952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f6fa6-dd78-4298-b090-50501aa1cba3 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:11.411229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f6fa6-dd78-4298-b090-50501aa1cba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:11.434372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-541f6fa6-dd78-4298-b090-50501aa1cba3 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:11.435941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-541f6fa6-dd78-4298-b090-50501aa1cba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:11.500425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c44a6-133f-4732-ae04-1d50fda2c783 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:11.514657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 235/469] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:11.516077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f6fa6-dd78-4298-b090-50501aa1cba3 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:11.567221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db532e-8c9b-477b-81fc-e50619c14852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:11.568035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db532e-8c9b-477b-81fc-e50619c14852 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:11.568331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db532e-8c9b-477b-81fc-e50619c14852 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:11.568602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db532e-8c9b-477b-81fc-e50619c14852 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:11.569451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db532e-8c9b-477b-81fc-e50619c14852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:11.569649 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db532e-8c9b-477b-81fc-e50619c14852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:11.571051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db532e-8c9b-477b-81fc-e50619c14852 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:11.584365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 235/470] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:11.585293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db532e-8c9b-477b-81fc-e50619c14852 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:11.652106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:11.661460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:11.667908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f6fa6-dd78-4298-b090-50501aa1cba3 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:11.705033 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974586cc-497a-4bc0-9ebe-2a3cd79d9b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:11.706224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974586cc-497a-4bc0-9ebe-2a3cd79d9b60 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:11.706580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974586cc-497a-4bc0-9ebe-2a3cd79d9b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:11.707350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974586cc-497a-4bc0-9ebe-2a3cd79d9b60 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:11.708231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974586cc-497a-4bc0-9ebe-2a3cd79d9b60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:11.709689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974586cc-497a-4bc0-9ebe-2a3cd79d9b60 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:11.742824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db532e-8c9b-477b-81fc-e50619c14852 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:11.776928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001c0f7-359c-4715-9b48-cb226450de4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:11.777574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001c0f7-359c-4715-9b48-cb226450de4d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:11.777854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001c0f7-359c-4715-9b48-cb226450de4d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:11.778126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001c0f7-359c-4715-9b48-cb226450de4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:11.789100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001c0f7-359c-4715-9b48-cb226450de4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:11.790546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001c0f7-359c-4715-9b48-cb226450de4d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:11.803522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 236/471] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:25:11 2022] POST /identity/v3/users => generated 248 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:25:11.804494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974586cc-497a-4bc0-9ebe-2a3cd79d9b60 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-d001c0f7-359c-4715-9b48-cb226450de4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:11.806433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:11.807451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:11.808524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:11.808524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:11.808524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:11.808524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:11.811625 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 236/472] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:11.813187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5138c-feaa-4fe0-9f6a-d58520a5799b None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:11.813618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5138c-feaa-4fe0-9f6a-d58520a5799b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:11.814036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5138c-feaa-4fe0-9f6a-d58520a5799b None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:11.815760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 237/473] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:11.817213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5138c-feaa-4fe0-9f6a-d58520a5799b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:11.920784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:11.952535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974586cc-497a-4bc0-9ebe-2a3cd79d9b60 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:11.957095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5138c-feaa-4fe0-9f6a-d58520a5799b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:11.994748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3758-7352-4af0-92ce-60c9bd9caaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:11.995525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3758-7352-4af0-92ce-60c9bd9caaff None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:11.996142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3758-7352-4af0-92ce-60c9bd9caaff None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:11.996425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3758-7352-4af0-92ce-60c9bd9caaff None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:11.997124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3758-7352-4af0-92ce-60c9bd9caaff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:11.998586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3758-7352-4af0-92ce-60c9bd9caaff None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:12.001979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24bef2-364f-4ec5-9891-1ffce1e7e19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:12.002772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24bef2-364f-4ec5-9891-1ffce1e7e19a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:12.003201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24bef2-364f-4ec5-9891-1ffce1e7e19a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:12.004345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24bef2-364f-4ec5-9891-1ffce1e7e19a None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:12.007202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24bef2-364f-4ec5-9891-1ffce1e7e19a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:12.007202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24bef2-364f-4ec5-9891-1ffce1e7e19a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:12.007202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24bef2-364f-4ec5-9891-1ffce1e7e19a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:12.019704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 238/474] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:12.021054 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c88f0-e9ac-4d79-acbb-3943cb7ff7f0 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:12.022264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c88f0-e9ac-4d79-acbb-3943cb7ff7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:12.022264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c88f0-e9ac-4d79-acbb-3943cb7ff7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:12.042164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-388c88f0-e9ac-4d79-acbb-3943cb7ff7f0 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:12.043388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-388c88f0-e9ac-4d79-acbb-3943cb7ff7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:12.105483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 237/475] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:25:11 2022] POST /identity/v3/users => generated 248 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:25:12.106310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3758-7352-4af0-92ce-60c9bd9caaff None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:12.111111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:12.126506 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 239/476] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:12.176559 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c88f0-e9ac-4d79-acbb-3943cb7ff7f0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:12.265031 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:12.302834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c88f0-e9ac-4d79-acbb-3943cb7ff7f0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:12.323787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3758-7352-4af0-92ce-60c9bd9caaff None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:12.343009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbd9c1-7540-4eaf-9c61-cf1d5d890c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:12.344095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd9c1-7540-4eaf-9c61-cf1d5d890c12 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:12.344558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd9c1-7540-4eaf-9c61-cf1d5d890c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:12.345371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd9c1-7540-4eaf-9c61-cf1d5d890c12 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:12.346572 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbd9c1-7540-4eaf-9c61-cf1d5d890c12 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:12.348649 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbd9c1-7540-4eaf-9c61-cf1d5d890c12 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:12.373083 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45ec6b-0548-4dc2-8818-5447840ccd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:12.373817 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45ec6b-0548-4dc2-8818-5447840ccd77 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:12.374113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45ec6b-0548-4dc2-8818-5447840ccd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:12.374417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45ec6b-0548-4dc2-8818-5447840ccd77 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:12.375107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45ec6b-0548-4dc2-8818-5447840ccd77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:12.376573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45ec6b-0548-4dc2-8818-5447840ccd77 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:12.385445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.sql.core [None req-58fbd9c1-7540-4eaf-9c61-cf1d5d890c12 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 21:25:12.385445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 21:25:12.385445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [parameters: {'id': 'acaa8afcaee64e6a88499715aa77258f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 21:25:12.385445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80307) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-58fbd9c1-7540-4eaf-9c61-cf1d5d890c12 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application conn.query(q) Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application result.read() Jul 25 21:25:12.413327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return ref.to_dict() Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 21:25:12.414259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application next(self.gen) Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application yield resource Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application next(self.gen) Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise self.value Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application session.commit() Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 21:25:12.415177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.session.flush() Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application compat.raise_( Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 21:25:12.416075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 21:25:12.416940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application conn.query(q) Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application result.read() Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 21:25:12.418095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [parameters: {'id': 'acaa8afcaee64e6a88499715aa77258f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:12.419581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 21:25:12.421854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:12.424147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 240/477] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 25 21:25:12 2022] POST /identity/v3/roles => generated 144 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:12.424147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbd9c1-7540-4eaf-9c61-cf1d5d890c12 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:12.486629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 238/478] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:25:12 2022] POST /identity/v3/users => generated 249 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:25:12.570658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbd9c1-7540-4eaf-9c61-cf1d5d890c12 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:12.626178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2d305-e62e-4cee-a6a4-dac4491009c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:12.626859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2d305-e62e-4cee-a6a4-dac4491009c9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:12.627146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2d305-e62e-4cee-a6a4-dac4491009c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:12.627422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2d305-e62e-4cee-a6a4-dac4491009c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:12.632275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:12.646322 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2d305-e62e-4cee-a6a4-dac4491009c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b3c2d305-e62e-4cee-a6a4-dac4491009c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:12.651661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:12.656657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:12.658605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:12.658605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:12.658605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:12.658605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:12.658605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:12.658605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:12.658605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:12.658605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:12.658605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:12.658605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:12.658605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 21:25:12.658605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:12.658605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 241/479] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:25:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:12.663250 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45ec6b-0548-4dc2-8818-5447840ccd77 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:12.735672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:12.783630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45ec6b-0548-4dc2-8818-5447840ccd77 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:12.825232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464fa84-ee42-4c32-a930-ddb6005645bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:12.825839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464fa84-ee42-4c32-a930-ddb6005645bb None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:12.826169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464fa84-ee42-4c32-a930-ddb6005645bb None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:12.826455 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464fa84-ee42-4c32-a930-ddb6005645bb None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:12.827186 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464fa84-ee42-4c32-a930-ddb6005645bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:12.827496 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464fa84-ee42-4c32-a930-ddb6005645bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:12.828900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464fa84-ee42-4c32-a930-ddb6005645bb None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:12.837723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 239/480] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:13.692612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5bbad-e7b3-4a5f-9f90-a3d5abc4ade4 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:13.692612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5bbad-e7b3-4a5f-9f90-a3d5abc4ade4 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:13.692612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5bbad-e7b3-4a5f-9f90-a3d5abc4ade4 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:13.693278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 242/481] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:13.698487 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d971e27-c7f2-4977-bfc3-7d81692005d4 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:13.698901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d971e27-c7f2-4977-bfc3-7d81692005d4 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:13.699300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d971e27-c7f2-4977-bfc3-7d81692005d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:13.724760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-3d971e27-c7f2-4977-bfc3-7d81692005d4 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:13.726018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-3d971e27-c7f2-4977-bfc3-7d81692005d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:13.810290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 240/482] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:13.844658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5bbad-e7b3-4a5f-9f90-a3d5abc4ade4 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:13.966634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5bbad-e7b3-4a5f-9f90-a3d5abc4ade4 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:14.002107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f06ab-6d91-43a2-9ef8-07208893aea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:14.003160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f06ab-6d91-43a2-9ef8-07208893aea6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:14.004176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f06ab-6d91-43a2-9ef8-07208893aea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:14.004652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f06ab-6d91-43a2-9ef8-07208893aea6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:14.015316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f06ab-6d91-43a2-9ef8-07208893aea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-881f06ab-6d91-43a2-9ef8-07208893aea6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:14.021112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:14.022014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:14.022808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:14.022808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:14.022808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:14.022808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:14.022808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:14.022808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:14.022808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:14.022808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:14.022808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:14.022808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:14.022808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:14.022808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:14.025495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 243/483] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:14.031293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d971e27-c7f2-4977-bfc3-7d81692005d4 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:14.096403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:14.147095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d971e27-c7f2-4977-bfc3-7d81692005d4 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:14.195327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b63f74-3126-49b2-992f-5a8d5ec4f995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:14.196035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63f74-3126-49b2-992f-5a8d5ec4f995 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:14.196331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63f74-3126-49b2-992f-5a8d5ec4f995 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:14.196607 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63f74-3126-49b2-992f-5a8d5ec4f995 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:14.197394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b63f74-3126-49b2-992f-5a8d5ec4f995 None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:14.197705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b63f74-3126-49b2-992f-5a8d5ec4f995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:14.199136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b63f74-3126-49b2-992f-5a8d5ec4f995 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:14.208999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 241/484] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:14.214326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f06ab-6d91-43a2-9ef8-07208893aea6 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:14.295514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:14.338456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394bb8b-5277-42ee-9a66-36f9f15f8961 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:14.339101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394bb8b-5277-42ee-9a66-36f9f15f8961 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:14.339587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394bb8b-5277-42ee-9a66-36f9f15f8961 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:14.341379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 242/485] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:14.343704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f06ab-6d91-43a2-9ef8-07208893aea6 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:14.348331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc13d8b-c11f-46e9-99cc-0a896abf740b None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:14.348908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc13d8b-c11f-46e9-99cc-0a896abf740b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:14.349384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc13d8b-c11f-46e9-99cc-0a896abf740b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:14.384766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-6fc13d8b-c11f-46e9-99cc-0a896abf740b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:14.387341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-6fc13d8b-c11f-46e9-99cc-0a896abf740b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:14.412974 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc05b8-9c53-4a52-87d9-c594cebe2550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:14.414044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc05b8-9c53-4a52-87d9-c594cebe2550 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:14.414529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc05b8-9c53-4a52-87d9-c594cebe2550 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:14.415003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc05b8-9c53-4a52-87d9-c594cebe2550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:14.426629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc05b8-9c53-4a52-87d9-c594cebe2550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:14.428453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc05b8-9c53-4a52-87d9-c594cebe2550 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-22cc05b8-9c53-4a52-87d9-c594cebe2550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:14.444238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:14.445100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:14.445938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:14.445938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:14.445938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:14.445938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:14.448055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 244/486] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:14.453353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc05b8-9c53-4a52-87d9-c594cebe2550 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:14.529161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 243/487] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:14.578061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc13d8b-c11f-46e9-99cc-0a896abf740b None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:14.613766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc05b8-9c53-4a52-87d9-c594cebe2550 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:14.627504 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:14.654422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:14.661070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff17e9a-f3b1-4295-b8ee-b1ba725b7261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:14.662162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff17e9a-f3b1-4295-b8ee-b1ba725b7261 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:14.662588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff17e9a-f3b1-4295-b8ee-b1ba725b7261 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:14.663000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff17e9a-f3b1-4295-b8ee-b1ba725b7261 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:14.663868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff17e9a-f3b1-4295-b8ee-b1ba725b7261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:14.664669 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff17e9a-f3b1-4295-b8ee-b1ba725b7261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:14.667256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff17e9a-f3b1-4295-b8ee-b1ba725b7261 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:14.684437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 245/488] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:14.686575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff17e9a-f3b1-4295-b8ee-b1ba725b7261 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:14.770217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc13d8b-c11f-46e9-99cc-0a896abf740b None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:14.799530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff17e9a-f3b1-4295-b8ee-b1ba725b7261 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:14.813897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bf58f-3974-4f4d-83de-bb829a26226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:14.814724 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bf58f-3974-4f4d-83de-bb829a26226b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:14.815265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bf58f-3974-4f4d-83de-bb829a26226b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:14.816205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bf58f-3974-4f4d-83de-bb829a26226b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:14.829654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bf58f-3974-4f4d-83de-bb829a26226b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-f74bf58f-3974-4f4d-83de-bb829a26226b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:14.836600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:14.837482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:14.838266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:14.838266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:14.838266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:14.838266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:14.838266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:14.838266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:14.838266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:14.838266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:14.838266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:14.838266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:14.838266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:14.838266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:14.840816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e475450-e2c7-4b86-8368-940f3c837f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:14.841699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e475450-e2c7-4b86-8368-940f3c837f7e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:14.842177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e475450-e2c7-4b86-8368-940f3c837f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:14.842862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 244/489] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:14.843270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e475450-e2c7-4b86-8368-940f3c837f7e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:14.844152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ef59b-f9de-459c-bdc7-3da93a9962f4 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:14.844442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ef59b-f9de-459c-bdc7-3da93a9962f4 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:14.844719 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ef59b-f9de-459c-bdc7-3da93a9962f4 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:14.847608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 245/490] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:14.852332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ef59b-f9de-459c-bdc7-3da93a9962f4 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:14.852766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e475450-e2c7-4b86-8368-940f3c837f7e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:14.854554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e475450-e2c7-4b86-8368-940f3c837f7e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-8e475450-e2c7-4b86-8368-940f3c837f7e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:14.869428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:14.870403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:14.871268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:14.871268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:14.871268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:14.871268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:14.871268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:14.871268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:14.871268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:14.871268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:14.871268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:25:14.871268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:14.877564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 246/491] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 21:25:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:14.877564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d92b1-f6bb-4465-9ad4-35c20aa1b248 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:14.877564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d92b1-f6bb-4465-9ad4-35c20aa1b248 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:14.877564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d92b1-f6bb-4465-9ad4-35c20aa1b248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:14.894728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c01d92b1-f6bb-4465-9ad4-35c20aa1b248 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:14.896103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c01d92b1-f6bb-4465-9ad4-35c20aa1b248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:14.921322 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:14.968832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 247/492] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:14.970168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d92b1-f6bb-4465-9ad4-35c20aa1b248 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:14.982905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ef59b-f9de-459c-bdc7-3da93a9962f4 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:14.987092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:15.035921 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cde12-b4b8-41d6-82ff-4de4107e6ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:15.037465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cde12-b4b8-41d6-82ff-4de4107e6ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:15.038194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cde12-b4b8-41d6-82ff-4de4107e6ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:15.038675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cde12-b4b8-41d6-82ff-4de4107e6ec6 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:15.040103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cde12-b4b8-41d6-82ff-4de4107e6ec6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:15.040635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cde12-b4b8-41d6-82ff-4de4107e6ec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:15.042779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cde12-b4b8-41d6-82ff-4de4107e6ec6 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:15.060383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 246/493] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:15.062020 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cde12-b4b8-41d6-82ff-4de4107e6ec6 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:15.099629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d92b1-f6bb-4465-9ad4-35c20aa1b248 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:15.135924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb6be0-621a-4244-893f-f5d26515edbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:15.136523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb6be0-621a-4244-893f-f5d26515edbd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:15.136807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb6be0-621a-4244-893f-f5d26515edbd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:15.137083 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb6be0-621a-4244-893f-f5d26515edbd None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:15.137883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb6be0-621a-4244-893f-f5d26515edbd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:15.138201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb6be0-621a-4244-893f-f5d26515edbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:15.139681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb6be0-621a-4244-893f-f5d26515edbd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:15.183072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 248/494] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 21:25:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:15.184057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb6be0-621a-4244-893f-f5d26515edbd None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:15.184440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cde12-b4b8-41d6-82ff-4de4107e6ec6 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:15.202955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:15.222625 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c1b93-d028-4e3c-ba60-f47e50548580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:15.223268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c1b93-d028-4e3c-ba60-f47e50548580 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:15.223550 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c1b93-d028-4e3c-ba60-f47e50548580 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:15.223856 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c1b93-d028-4e3c-ba60-f47e50548580 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:15.234514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c1b93-d028-4e3c-ba60-f47e50548580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-2c7c1b93-d028-4e3c-ba60-f47e50548580 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:15.240038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:15.241244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:15.242049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:15.242049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:15.242049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:15.242049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:15.242049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:15.242049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:15.242049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:15.242049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:15.242049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:15.242049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:15.242049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:15.242049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:15.245419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 247/495] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:15.245419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c1b93-d028-4e3c-ba60-f47e50548580 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:15.274491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:15.292545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb6be0-621a-4244-893f-f5d26515edbd None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:15.330350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285d9d9-c550-4a57-bcbc-ffa5c44c41bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:15.331116 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285d9d9-c550-4a57-bcbc-ffa5c44c41bc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:15.332046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285d9d9-c550-4a57-bcbc-ffa5c44c41bc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:15.332503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285d9d9-c550-4a57-bcbc-ffa5c44c41bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:15.342913 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285d9d9-c550-4a57-bcbc-ffa5c44c41bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:15.344419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285d9d9-c550-4a57-bcbc-ffa5c44c41bc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:15.350888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c1b93-d028-4e3c-ba60-f47e50548580 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b285d9d9-c550-4a57-bcbc-ffa5c44c41bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:15.360124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:15.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:15.361802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:15.361802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:15.361802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:15.361802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:15.361802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 249/496] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:15.363031 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c382fc9-5016-4fa7-829d-8411c7ed2217 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:15.363031 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c382fc9-5016-4fa7-829d-8411c7ed2217 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:15.363274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c382fc9-5016-4fa7-829d-8411c7ed2217 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:15.368651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 250/497] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:15.369454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c382fc9-5016-4fa7-829d-8411c7ed2217 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:15.392921 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c740a8-78cb-43d2-a789-c694115b7a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:15.393546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c740a8-78cb-43d2-a789-c694115b7a9a None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:15.394371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c740a8-78cb-43d2-a789-c694115b7a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:15.394655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c740a8-78cb-43d2-a789-c694115b7a9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:15.444726 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:15.469833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c740a8-78cb-43d2-a789-c694115b7a9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:15.471287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c740a8-78cb-43d2-a789-c694115b7a9a None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:15.482365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c382fc9-5016-4fa7-829d-8411c7ed2217 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:15.497132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:15.516621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2765c0-811d-46d1-b9fe-668eea5a411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:15.517234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2765c0-811d-46d1-b9fe-668eea5a411e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:15.517518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2765c0-811d-46d1-b9fe-668eea5a411e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:15.517796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2765c0-811d-46d1-b9fe-668eea5a411e None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:15.518517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2765c0-811d-46d1-b9fe-668eea5a411e None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:15.518871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2765c0-811d-46d1-b9fe-668eea5a411e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:15.520354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2765c0-811d-46d1-b9fe-668eea5a411e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:15.528313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 251/498] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:15.529098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2765c0-811d-46d1-b9fe-668eea5a411e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:15.575397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 248/499] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:25:15.576941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5e595-b068-4582-9eda-c7f6345034db None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:15.577230 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5e595-b068-4582-9eda-c7f6345034db None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:15.577505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5e595-b068-4582-9eda-c7f6345034db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:15.594861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-3ac5e595-b068-4582-9eda-c7f6345034db None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:15.596090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-3ac5e595-b068-4582-9eda-c7f6345034db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:15.630265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2765c0-811d-46d1-b9fe-668eea5a411e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:15.657720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:15.662091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 249/500] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:15.663340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b3d64-077e-41b8-9c07-08849cae1e00 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:15.663608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b3d64-077e-41b8-9c07-08849cae1e00 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:15.663911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b3d64-077e-41b8-9c07-08849cae1e00 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:15.664023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5ff14-60dd-4495-9f66-49408ad77902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:15.664593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5ff14-60dd-4495-9f66-49408ad77902 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:15.664880 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5ff14-60dd-4495-9f66-49408ad77902 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:15.665345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 250/501] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:15.665457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5ff14-60dd-4495-9f66-49408ad77902 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:15.665825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b3d64-077e-41b8-9c07-08849cae1e00 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:15.669191 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5ff14-60dd-4495-9f66-49408ad77902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:15.669537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5ff14-60dd-4495-9f66-49408ad77902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:15.670989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5ff14-60dd-4495-9f66-49408ad77902 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:15.684834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 252/502] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:15.686762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5ff14-60dd-4495-9f66-49408ad77902 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:15.735153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:15.782880 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b3d64-077e-41b8-9c07-08849cae1e00 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:15.788240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5ff14-60dd-4495-9f66-49408ad77902 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:15.815824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c5ef9-0548-49f1-bafa-72eca99a9854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:15.816469 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c5ef9-0548-49f1-bafa-72eca99a9854 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:15.816748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c5ef9-0548-49f1-bafa-72eca99a9854 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:15.817019 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c5ef9-0548-49f1-bafa-72eca99a9854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:15.821786 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e48790-3270-4abd-aa71-e114995316c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:15.822425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e48790-3270-4abd-aa71-e114995316c0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:15.822708 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e48790-3270-4abd-aa71-e114995316c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:15.822987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e48790-3270-4abd-aa71-e114995316c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:15.827126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c5ef9-0548-49f1-bafa-72eca99a9854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:15.828598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c5ef9-0548-49f1-bafa-72eca99a9854 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:15.833815 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e48790-3270-4abd-aa71-e114995316c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:15.835269 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e48790-3270-4abd-aa71-e114995316c0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-b46c5ef9-0548-49f1-bafa-72eca99a9854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:15.842957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:15.843839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:15.844684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:15.844684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:15.844684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:15.844684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:15.844684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 251/503] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:15.845329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5803-6e96-4b6c-b5a7-a24837dd7e42 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:15.845581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5803-6e96-4b6c-b5a7-a24837dd7e42 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:15.845855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5803-6e96-4b6c-b5a7-a24837dd7e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-82e48790-3270-4abd-aa71-e114995316c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:15.855145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:15.856208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:15.857096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:15.857096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:15.857096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:15.857096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:15.857096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 253/504] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:15.857393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e48790-3270-4abd-aa71-e114995316c0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:15.866751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-21eb5803-6e96-4b6c-b5a7-a24837dd7e42 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:15.868393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-21eb5803-6e96-4b6c-b5a7-a24837dd7e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:15.901661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:15.936519 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 252/505] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:15.937360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb5803-6e96-4b6c-b5a7-a24837dd7e42 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:15.965031 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e48790-3270-4abd-aa71-e114995316c0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:15.978524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:15.998789 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9d5d4-324f-48d0-b66e-515753350231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:15.999427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9d5d4-324f-48d0-b66e-515753350231 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:15.999713 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9d5d4-324f-48d0-b66e-515753350231 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:16.000070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9d5d4-324f-48d0-b66e-515753350231 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:16.010797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9d5d4-324f-48d0-b66e-515753350231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-a9d9d5d4-324f-48d0-b66e-515753350231 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:16.017115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:16.018034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:16.018901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:16.018901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:16.018901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:16.018901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:16.018901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:16.018901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:16.018901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:16.018901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:16.018901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:16.018901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:16.018901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:16.018901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:16.018901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 254/506] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:16.020075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9d5d4-324f-48d0-b66e-515753350231 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:16.043574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb5803-6e96-4b6c-b5a7-a24837dd7e42 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:16.078637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90cb41-2933-44c9-b8c9-37a78c0ed88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:16.079270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90cb41-2933-44c9-b8c9-37a78c0ed88f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:16.079549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90cb41-2933-44c9-b8c9-37a78c0ed88f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:16.079847 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90cb41-2933-44c9-b8c9-37a78c0ed88f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:16.087699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90cb41-2933-44c9-b8c9-37a78c0ed88f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:16.089150 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90cb41-2933-44c9-b8c9-37a78c0ed88f None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-ae90cb41-2933-44c9-b8c9-37a78c0ed88f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:16.102586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:16.103508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:16.104655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:16.104655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:16.104655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:16.104655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:16.104655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:16.104655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:16.104655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:16.104655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:16.104655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:25:16.104655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:16.104655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 253/507] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:16.106484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90cb41-2933-44c9-b8c9-37a78c0ed88f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:16.118949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9d5d4-324f-48d0-b66e-515753350231 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:16.120517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:16.152739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc44b31-6760-4c82-8209-795b33bb90d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:16.153283 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44b31-6760-4c82-8209-795b33bb90d8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:16.153565 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44b31-6760-4c82-8209-795b33bb90d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:16.153841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44b31-6760-4c82-8209-795b33bb90d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:16.154537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc44b31-6760-4c82-8209-795b33bb90d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:16.154848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc44b31-6760-4c82-8209-795b33bb90d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:16.156267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc44b31-6760-4c82-8209-795b33bb90d8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:16.168297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 255/508] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:16.169095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc44b31-6760-4c82-8209-795b33bb90d8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:16.203378 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:16.207339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90cb41-2933-44c9-b8c9-37a78c0ed88f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:16.241614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bcc38-bfa4-49bd-bf62-48ca1519e488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:16.242231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bcc38-bfa4-49bd-bf62-48ca1519e488 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:16.242512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bcc38-bfa4-49bd-bf62-48ca1519e488 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:16.242785 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bcc38-bfa4-49bd-bf62-48ca1519e488 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:16.243502 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bcc38-bfa4-49bd-bf62-48ca1519e488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:16.243832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bcc38-bfa4-49bd-bf62-48ca1519e488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:16.245204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bcc38-bfa4-49bd-bf62-48ca1519e488 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:16.256492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 254/509] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:16.257577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bcc38-bfa4-49bd-bf62-48ca1519e488 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:16.273443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc44b31-6760-4c82-8209-795b33bb90d8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:16.307936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f408c76-9b44-4118-89c7-66e47dc59c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:16.308577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f408c76-9b44-4118-89c7-66e47dc59c10 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:16.308858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f408c76-9b44-4118-89c7-66e47dc59c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:16.309131 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f408c76-9b44-4118-89c7-66e47dc59c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:16.319769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f408c76-9b44-4118-89c7-66e47dc59c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:16.321208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f408c76-9b44-4118-89c7-66e47dc59c10 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2f408c76-9b44-4118-89c7-66e47dc59c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:16.335620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:16.336499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:16.337346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:16.337346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:16.337346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:16.337346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:16.337346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 256/510] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:16.337611 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f408c76-9b44-4118-89c7-66e47dc59c10 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:16.353838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:16.357951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bcc38-bfa4-49bd-bf62-48ca1519e488 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:16.390849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a881fa4-a367-4d95-8ad3-a4de0b63686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:16.391620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a881fa4-a367-4d95-8ad3-a4de0b63686d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:16.391935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a881fa4-a367-4d95-8ad3-a4de0b63686d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:16.392217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a881fa4-a367-4d95-8ad3-a4de0b63686d None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:16.392931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a881fa4-a367-4d95-8ad3-a4de0b63686d None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:16.393237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a881fa4-a367-4d95-8ad3-a4de0b63686d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:16.395186 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a881fa4-a367-4d95-8ad3-a4de0b63686d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:16.403005 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 255/511] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:16.403714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a881fa4-a367-4d95-8ad3-a4de0b63686d None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:16.426458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:16.439242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f408c76-9b44-4118-89c7-66e47dc59c10 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:16.474686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4883cf-b17e-4814-95f4-b4b3644b4651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:16.475308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4883cf-b17e-4814-95f4-b4b3644b4651 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:16.475589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4883cf-b17e-4814-95f4-b4b3644b4651 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:16.475911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4883cf-b17e-4814-95f4-b4b3644b4651 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:16.476709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4883cf-b17e-4814-95f4-b4b3644b4651 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:16.477018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4883cf-b17e-4814-95f4-b4b3644b4651 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:16.478472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4883cf-b17e-4814-95f4-b4b3644b4651 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:16.499779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 257/512] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 25 21:25:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:16.499779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4883cf-b17e-4814-95f4-b4b3644b4651 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:16.505221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a881fa4-a367-4d95-8ad3-a4de0b63686d None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:16.539615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c02d14-2867-4009-baf7-12fbe02a1b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:16.540313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c02d14-2867-4009-baf7-12fbe02a1b81 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:16.540596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c02d14-2867-4009-baf7-12fbe02a1b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:16.540984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c02d14-2867-4009-baf7-12fbe02a1b81 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:16.548598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c02d14-2867-4009-baf7-12fbe02a1b81 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:16.550048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c02d14-2867-4009-baf7-12fbe02a1b81 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-c5c02d14-2867-4009-baf7-12fbe02a1b81 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:16.561924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:16.562978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:16.568801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:16.568801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:16.568801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:16.568801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:16.568801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:16.568801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:16.568801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:16.568801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:16.568801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:25:16.568801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:16.568801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 256/513] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:16.568801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c02d14-2867-4009-baf7-12fbe02a1b81 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:16.569540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:16.596396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4883cf-b17e-4814-95f4-b4b3644b4651 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:16.633073 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f82088-9db1-4fcb-a7ca-8a93fda89834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:16.633718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82088-9db1-4fcb-a7ca-8a93fda89834 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:16.634002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82088-9db1-4fcb-a7ca-8a93fda89834 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:16.634278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82088-9db1-4fcb-a7ca-8a93fda89834 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:16.641241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f82088-9db1-4fcb-a7ca-8a93fda89834 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:16.642714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f82088-9db1-4fcb-a7ca-8a93fda89834 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:16.650592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-79f82088-9db1-4fcb-a7ca-8a93fda89834 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:16.662234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:16.663338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:16.664438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:16.664438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:16.664438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:16.664438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:16.664438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:16.664438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:16.664438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:16.664438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:16.664438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 258/514] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:16.664438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f82088-9db1-4fcb-a7ca-8a93fda89834 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:16.678472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c02d14-2867-4009-baf7-12fbe02a1b81 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:16.712571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d61ab6-781f-4e58-a9af-459987e33f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:16.713200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d61ab6-781f-4e58-a9af-459987e33f12 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:16.713483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d61ab6-781f-4e58-a9af-459987e33f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:16.713757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d61ab6-781f-4e58-a9af-459987e33f12 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:16.714455 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d61ab6-781f-4e58-a9af-459987e33f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:16.714761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d61ab6-781f-4e58-a9af-459987e33f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:16.716193 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d61ab6-781f-4e58-a9af-459987e33f12 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:16.728702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 257/515] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:16.729600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d61ab6-781f-4e58-a9af-459987e33f12 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:16.766128 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f82088-9db1-4fcb-a7ca-8a93fda89834 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:16.797704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:16.803598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3955b-b529-4b5f-bd3f-f3dabb93a3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:16.804416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3955b-b529-4b5f-bd3f-f3dabb93a3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:16.804700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3955b-b529-4b5f-bd3f-f3dabb93a3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:16.804977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3955b-b529-4b5f-bd3f-f3dabb93a3d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:16.815343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3955b-b529-4b5f-bd3f-f3dabb93a3d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:16.817042 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3955b-b529-4b5f-bd3f-f3dabb93a3d0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:16.829504 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d61ab6-781f-4e58-a9af-459987e33f12 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-84a3955b-b529-4b5f-bd3f-f3dabb93a3d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:16.833499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:16.834722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:16.840425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:16.840425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:16.840425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:16.840425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:16.840425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 259/516] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:16.840425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3955b-b529-4b5f-bd3f-f3dabb93a3d0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:16.866002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b62335-40af-497f-8e99-c6e7d432a10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:16.866411 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b62335-40af-497f-8e99-c6e7d432a10f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:16.866693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b62335-40af-497f-8e99-c6e7d432a10f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:16.866962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b62335-40af-497f-8e99-c6e7d432a10f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:16.877871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:16.935822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b62335-40af-497f-8e99-c6e7d432a10f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:16.936707 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3955b-b529-4b5f-bd3f-f3dabb93a3d0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:16.937208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b62335-40af-497f-8e99-c6e7d432a10f None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:16.971157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367744d-c52f-4330-92dc-402f7e1605e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:16.972368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367744d-c52f-4330-92dc-402f7e1605e0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:16.972706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367744d-c52f-4330-92dc-402f7e1605e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:16.973076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367744d-c52f-4330-92dc-402f7e1605e0 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:16.973866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367744d-c52f-4330-92dc-402f7e1605e0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:16.974169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367744d-c52f-4330-92dc-402f7e1605e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:16.975592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367744d-c52f-4330-92dc-402f7e1605e0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:16.992832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 260/517] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 25 21:25:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:16.997291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367744d-c52f-4330-92dc-402f7e1605e0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:17.040983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 258/518] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:25:17.041808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b62335-40af-497f-8e99-c6e7d432a10f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:17.047189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:17.085285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:17.106743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367744d-c52f-4330-92dc-402f7e1605e0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:17.141051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace01e8-f797-40c1-aca9-23ebba975529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:17.141654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace01e8-f797-40c1-aca9-23ebba975529 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:17.141930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace01e8-f797-40c1-aca9-23ebba975529 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:17.142201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace01e8-f797-40c1-aca9-23ebba975529 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:17.142337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b62335-40af-497f-8e99-c6e7d432a10f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:17.142943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace01e8-f797-40c1-aca9-23ebba975529 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:17.143246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace01e8-f797-40c1-aca9-23ebba975529 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:17.145160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace01e8-f797-40c1-aca9-23ebba975529 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:17.167850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 261/519] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:17.167850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace01e8-f797-40c1-aca9-23ebba975529 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:17.175461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5c9a8-f732-4b09-a434-c753bcfafed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:17.176269 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5c9a8-f732-4b09-a434-c753bcfafed9 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:17.176564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5c9a8-f732-4b09-a434-c753bcfafed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:17.176838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5c9a8-f732-4b09-a434-c753bcfafed9 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:17.177511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5c9a8-f732-4b09-a434-c753bcfafed9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:17.178941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5c9a8-f732-4b09-a434-c753bcfafed9 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:17.247768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 259/520] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:25:17 2022] POST /identity/v3/users => generated 247 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:25:17.248528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5c9a8-f732-4b09-a434-c753bcfafed9 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:17.276162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace01e8-f797-40c1-aca9-23ebba975529 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:17.278147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:17.317394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c8b7d-b725-4416-bd94-0d1dac2e6603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:17.318125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c8b7d-b725-4416-bd94-0d1dac2e6603 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:17.318410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c8b7d-b725-4416-bd94-0d1dac2e6603 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:17.318694 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c8b7d-b725-4416-bd94-0d1dac2e6603 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:17.319410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c8b7d-b725-4416-bd94-0d1dac2e6603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:17.319720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c8b7d-b725-4416-bd94-0d1dac2e6603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:17.321290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c8b7d-b725-4416-bd94-0d1dac2e6603 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:17.334961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 262/521] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:17.335949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c8b7d-b725-4416-bd94-0d1dac2e6603 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:17.369124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:17.375520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5c9a8-f732-4b09-a434-c753bcfafed9 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:17.418600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9417d-2293-4be9-ae8f-c091d4eb1f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:17.419237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9417d-2293-4be9-ae8f-c091d4eb1f04 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:17.419514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9417d-2293-4be9-ae8f-c091d4eb1f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:17.419807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9417d-2293-4be9-ae8f-c091d4eb1f04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:17.454889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c8b7d-b725-4416-bd94-0d1dac2e6603 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:17.496365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f35aeb-7357-41da-a81c-8a243ee5cd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:17.497018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f35aeb-7357-41da-a81c-8a243ee5cd07 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:17.497305 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f35aeb-7357-41da-a81c-8a243ee5cd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:17.497582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f35aeb-7357-41da-a81c-8a243ee5cd07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:17.499443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9417d-2293-4be9-ae8f-c091d4eb1f04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:17.500775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9417d-2293-4be9-ae8f-c091d4eb1f04 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:17.508644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f35aeb-7357-41da-a81c-8a243ee5cd07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:17.510172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f35aeb-7357-41da-a81c-8a243ee5cd07 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-18f35aeb-7357-41da-a81c-8a243ee5cd07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:17.525497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:17.526556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:17.527514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:17.527514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:17.527514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:17.527514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:17.527514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 263/522] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:17.527514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f35aeb-7357-41da-a81c-8a243ee5cd07 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:17.544294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:17.611399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:17.619386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 260/523] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:25:17.620508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9417d-2293-4be9-ae8f-c091d4eb1f04 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:17.643186 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f35aeb-7357-41da-a81c-8a243ee5cd07 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:17.693849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c21aeb-1d1b-4b49-88eb-c8adf5cf3ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:17.694476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c21aeb-1d1b-4b49-88eb-c8adf5cf3ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:17.694759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c21aeb-1d1b-4b49-88eb-c8adf5cf3ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:17.695034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c21aeb-1d1b-4b49-88eb-c8adf5cf3ea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:17.695875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c21aeb-1d1b-4b49-88eb-c8adf5cf3ea5 None admin] RBAC: Adding query filter params (role.id=41a3de4f5213430bb14205f0f3aabadc, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=7d3d6613476c445b82302df5025f3ce6) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:17.696191 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c21aeb-1d1b-4b49-88eb-c8adf5cf3ea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:17.697631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c21aeb-1d1b-4b49-88eb-c8adf5cf3ea5 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:17.704694 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 264/524] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:17 2022] GET /identity/v3/role_assignments?user.id=7d3d6613476c445b82302df5025f3ce6&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=41a3de4f5213430bb14205f0f3aabadc => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:17.705812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c21aeb-1d1b-4b49-88eb-c8adf5cf3ea5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:17.728994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9417d-2293-4be9-ae8f-c091d4eb1f04 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:17.779135 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b85f0-d476-4db9-bb2f-28b37d2632fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:17.781502 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b85f0-d476-4db9-bb2f-28b37d2632fc None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:17.781989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b85f0-d476-4db9-bb2f-28b37d2632fc None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:17.782474 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b85f0-d476-4db9-bb2f-28b37d2632fc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:17.791850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b85f0-d476-4db9-bb2f-28b37d2632fc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:17.793792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b85f0-d476-4db9-bb2f-28b37d2632fc None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-df6b85f0-d476-4db9-bb2f-28b37d2632fc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:17.807923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:17.808874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:17.809738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:17.809738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:17.809738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:17.809738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:17.809738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:17.809738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:17.809738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:17.809738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:17.809738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:25:17.809738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:17.812539 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 261/525] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:17.813684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b85f0-d476-4db9-bb2f-28b37d2632fc None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:17.836162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:17.865483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c21aeb-1d1b-4b49-88eb-c8adf5cf3ea5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:17.883285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:17.913254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438acc-76db-4f88-90fe-c7378e368e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:17.913888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438acc-76db-4f88-90fe-c7378e368e88 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:17.914174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438acc-76db-4f88-90fe-c7378e368e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:17.914452 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438acc-76db-4f88-90fe-c7378e368e88 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:17.915445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40438acc-76db-4f88-90fe-c7378e368e88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:17.915850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40438acc-76db-4f88-90fe-c7378e368e88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:17.917928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40438acc-76db-4f88-90fe-c7378e368e88 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:17.934348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b85f0-d476-4db9-bb2f-28b37d2632fc None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:17.939149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 265/526] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:17.941698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438acc-76db-4f88-90fe-c7378e368e88 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:17.974607 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320d892-5c53-4494-90df-0e1f1e8b9384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:17.975600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320d892-5c53-4494-90df-0e1f1e8b9384 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:17.976212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320d892-5c53-4494-90df-0e1f1e8b9384 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:17.976682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320d892-5c53-4494-90df-0e1f1e8b9384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:17.989211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320d892-5c53-4494-90df-0e1f1e8b9384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:17.990935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320d892-5c53-4494-90df-0e1f1e8b9384 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-4320d892-5c53-4494-90df-0e1f1e8b9384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:18.007077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:18.008036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:18.008859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:18.008859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:18.008859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:18.008859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:18.011214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 262/527] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:18.012358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320d892-5c53-4494-90df-0e1f1e8b9384 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:18.084255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438acc-76db-4f88-90fe-c7378e368e88 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:18.122670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320d892-5c53-4494-90df-0e1f1e8b9384 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:18.132729 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:18.137338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4caee7-1557-4265-b3f0-ee3dba586cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:18.138122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4caee7-1557-4265-b3f0-ee3dba586cee None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:18.138407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4caee7-1557-4265-b3f0-ee3dba586cee None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:18.138685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4caee7-1557-4265-b3f0-ee3dba586cee None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:18.139900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4caee7-1557-4265-b3f0-ee3dba586cee None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:18.140219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4caee7-1557-4265-b3f0-ee3dba586cee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:18.141933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4caee7-1557-4265-b3f0-ee3dba586cee None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:18.154809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:18.166308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 266/528] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Jul 25 21:25:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:18.166888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6432bc-e508-4aa4-b879-09f3848dce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:18.167603 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6432bc-e508-4aa4-b879-09f3848dce00 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:18.167871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4caee7-1557-4265-b3f0-ee3dba586cee None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:18.167990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6432bc-e508-4aa4-b879-09f3848dce00 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:18.168249 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6432bc-e508-4aa4-b879-09f3848dce00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:18.178113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6432bc-e508-4aa4-b879-09f3848dce00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:18.179584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6432bc-e508-4aa4-b879-09f3848dce00 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-5e6432bc-e508-4aa4-b879-09f3848dce00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:18.194472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:18.195360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:18.196237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:18.196237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:18.196237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:18.196237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:18.196237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:18.196237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:18.196237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:18.196237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:18.200146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 263/529] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:18.200939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6432bc-e508-4aa4-b879-09f3848dce00 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:18.280022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4caee7-1557-4265-b3f0-ee3dba586cee None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:18.310649 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6432bc-e508-4aa4-b879-09f3848dce00 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:18.318214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208f165-4022-447d-9e13-1f6252fb66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:18.319178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208f165-4022-447d-9e13-1f6252fb66ad None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:18.319674 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208f165-4022-447d-9e13-1f6252fb66ad None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:18.320233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208f165-4022-447d-9e13-1f6252fb66ad None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:18.321175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208f165-4022-447d-9e13-1f6252fb66ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:18.321887 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208f165-4022-447d-9e13-1f6252fb66ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:18.323474 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208f165-4022-447d-9e13-1f6252fb66ad None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:18.336939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 267/530] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:18.338175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208f165-4022-447d-9e13-1f6252fb66ad None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:18.347225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5e3bf-bfab-4b48-ac7d-7768cbc099e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:18.347890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e3bf-bfab-4b48-ac7d-7768cbc099e5 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:18.348161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e3bf-bfab-4b48-ac7d-7768cbc099e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:18.348434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5e3bf-bfab-4b48-ac7d-7768cbc099e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:18.395621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:18.421331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:18.451286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5e3bf-bfab-4b48-ac7d-7768cbc099e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:18.453329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5e3bf-bfab-4b48-ac7d-7768cbc099e5 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:18.483224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208f165-4022-447d-9e13-1f6252fb66ad None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:18.526953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d40a05-cf51-4390-a65c-3dcd5e310b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:18.527588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40a05-cf51-4390-a65c-3dcd5e310b99 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:18.527900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40a05-cf51-4390-a65c-3dcd5e310b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:18.528223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d40a05-cf51-4390-a65c-3dcd5e310b99 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:18.529536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40a05-cf51-4390-a65c-3dcd5e310b99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:18.529850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40a05-cf51-4390-a65c-3dcd5e310b99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:18.531567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d40a05-cf51-4390-a65c-3dcd5e310b99 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:18.556219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 268/531] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:18.557118 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d40a05-cf51-4390-a65c-3dcd5e310b99 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:18.584950 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 264/532] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:25:18.586249 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5e3bf-bfab-4b48-ac7d-7768cbc099e5 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:18.663536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:18.691376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d40a05-cf51-4390-a65c-3dcd5e310b99 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:18.704788 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5e3bf-bfab-4b48-ac7d-7768cbc099e5 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:18.714905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:18.736619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc75278-3c59-44ed-905e-6b3c3fe11718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:18.738555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75278-3c59-44ed-905e-6b3c3fe11718 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:18.739113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75278-3c59-44ed-905e-6b3c3fe11718 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:18.739634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75278-3c59-44ed-905e-6b3c3fe11718 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:18.747732 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc75278-3c59-44ed-905e-6b3c3fe11718 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:18.749456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc75278-3c59-44ed-905e-6b3c3fe11718 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:18.751109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a65710-9614-4e5f-b432-afcac6ff2783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:18.752169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a65710-9614-4e5f-b432-afcac6ff2783 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:18.752997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a65710-9614-4e5f-b432-afcac6ff2783 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:18.753503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a65710-9614-4e5f-b432-afcac6ff2783 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:18.754580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a65710-9614-4e5f-b432-afcac6ff2783 None admin] RBAC: Adding query filter params (role.id=41a3de4f5213430bb14205f0f3aabadc, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=f4ceb49020974e89b264c2a874dd82cf) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:18.754997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a65710-9614-4e5f-b432-afcac6ff2783 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:18.756565 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a65710-9614-4e5f-b432-afcac6ff2783 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:18.771796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 265/533] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:18 2022] GET /identity/v3/role_assignments?user.id=f4ceb49020974e89b264c2a874dd82cf&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=41a3de4f5213430bb14205f0f3aabadc => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:18.771796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a65710-9614-4e5f-b432-afcac6ff2783 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-afc75278-3c59-44ed-905e-6b3c3fe11718 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:18.772841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:18.773664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:18.774493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:18.774493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:18.774493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:18.774493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:18.774493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:18.774493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:18.774493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:18.774493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:18.777275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 269/534] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:18.783571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc75278-3c59-44ed-905e-6b3c3fe11718 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:18.890097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a65710-9614-4e5f-b432-afcac6ff2783 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:18.932401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa21ccf-c08f-44cc-adbe-bebce558428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:18.933476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:18.934665 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa21ccf-c08f-44cc-adbe-bebce558428c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:18.935164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa21ccf-c08f-44cc-adbe-bebce558428c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:18.935643 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa21ccf-c08f-44cc-adbe-bebce558428c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:18.950028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa21ccf-c08f-44cc-adbe-bebce558428c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:18.957360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa21ccf-c08f-44cc-adbe-bebce558428c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-bfa21ccf-c08f-44cc-adbe-bebce558428c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:18.970358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:18.971263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:18.972387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:18.972387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:18.972387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:18.972387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:18.974502 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 266/535] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:18.980381 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa21ccf-c08f-44cc-adbe-bebce558428c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:19.038322 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc75278-3c59-44ed-905e-6b3c3fe11718 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:19.085677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c8c85-e09c-4a22-a4d4-9ecd098e5f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:19.086311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c8c85-e09c-4a22-a4d4-9ecd098e5f67 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:19.086596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c8c85-e09c-4a22-a4d4-9ecd098e5f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:19.087233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c8c85-e09c-4a22-a4d4-9ecd098e5f67 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:19.088045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c8c85-e09c-4a22-a4d4-9ecd098e5f67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:19.088361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c8c85-e09c-4a22-a4d4-9ecd098e5f67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:19.090131 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c8c85-e09c-4a22-a4d4-9ecd098e5f67 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:19.107857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 270/536] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:19.112127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c8c85-e09c-4a22-a4d4-9ecd098e5f67 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:19.125963 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa21ccf-c08f-44cc-adbe-bebce558428c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:19.166381 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ffbb1-6893-435e-98b4-eec756d6be07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:19.167008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ffbb1-6893-435e-98b4-eec756d6be07 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:19.167293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ffbb1-6893-435e-98b4-eec756d6be07 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:19.167673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ffbb1-6893-435e-98b4-eec756d6be07 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:19.168593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:19.169076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ffbb1-6893-435e-98b4-eec756d6be07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:19.169387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ffbb1-6893-435e-98b4-eec756d6be07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:19.170810 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ffbb1-6893-435e-98b4-eec756d6be07 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:19.190225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 267/537] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:19.191453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ffbb1-6893-435e-98b4-eec756d6be07 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:19.245394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:19.308661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ffbb1-6893-435e-98b4-eec756d6be07 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:19.348849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bef79-c49f-4997-9e76-f5c090fbd9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:19.349508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bef79-c49f-4997-9e76-f5c090fbd9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:19.349793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bef79-c49f-4997-9e76-f5c090fbd9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:19.349964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c8c85-e09c-4a22-a4d4-9ecd098e5f67 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:19.350064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bef79-c49f-4997-9e76-f5c090fbd9c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:19.358495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bef79-c49f-4997-9e76-f5c090fbd9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:19.359982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bef79-c49f-4997-9e76-f5c090fbd9c0 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-908bef79-c49f-4997-9e76-f5c090fbd9c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:19.373380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:19.374257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:19.375100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:19.375100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:19.375100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:19.375100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:19.375100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:19.375100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:19.375100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:19.375100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:19.379843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 268/538] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:19.381397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bef79-c49f-4997-9e76-f5c090fbd9c0 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:19.422715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0d9d7-e933-4176-8233-ad453367d4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:19.423830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0d9d7-e933-4176-8233-ad453367d4dc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:19.424154 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0d9d7-e933-4176-8233-ad453367d4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:19.424445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0d9d7-e933-4176-8233-ad453367d4dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:19.425961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0d9d7-e933-4176-8233-ad453367d4dc None admin] RBAC: Adding query filter params (role.id=41a3de4f5213430bb14205f0f3aabadc, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=8ed104145f1f4a3aa76659ae6ceac4ef) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:19.426279 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0d9d7-e933-4176-8233-ad453367d4dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:19.427756 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0d9d7-e933-4176-8233-ad453367d4dc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:19.433801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 271/539] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:19 2022] GET /identity/v3/role_assignments?user.id=8ed104145f1f4a3aa76659ae6ceac4ef&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=41a3de4f5213430bb14205f0f3aabadc => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:19.435023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3e31f-75b8-4233-8a14-e9310ab62768 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:19.435316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3e31f-75b8-4233-8a14-e9310ab62768 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:19.435594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3e31f-75b8-4233-8a14-e9310ab62768 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:19.437080 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 272/540] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:19.449380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8620d-4615-4803-8936-d97d448d2cd7 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:19.449705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8620d-4615-4803-8936-d97d448d2cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:19.449865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8620d-4615-4803-8936-d97d448d2cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:19.494636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-02d8620d-4615-4803-8936-d97d448d2cd7 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:19.496302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-02d8620d-4615-4803-8936-d97d448d2cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:19.519339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bef79-c49f-4997-9e76-f5c090fbd9c0 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:19.524290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:19.591961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a56ec-1c7e-42b7-82a2-f50873c4e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:19.592961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a56ec-1c7e-42b7-82a2-f50873c4e52c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:19.593449 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a56ec-1c7e-42b7-82a2-f50873c4e52c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:19.594198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a56ec-1c7e-42b7-82a2-f50873c4e52c None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:19.596517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a56ec-1c7e-42b7-82a2-f50873c4e52c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:19.597598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a56ec-1c7e-42b7-82a2-f50873c4e52c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:19.599522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a56ec-1c7e-42b7-82a2-f50873c4e52c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:19.631124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 269/541] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:19.632465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a56ec-1c7e-42b7-82a2-f50873c4e52c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:19.650044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 273/542] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:19.706905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8620d-4615-4803-8936-d97d448d2cd7 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:19.758998 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a56ec-1c7e-42b7-82a2-f50873c4e52c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:19.787885 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:19.800399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de84ec-f902-442f-b1fe-4561e7a64517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:19.806827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de84ec-f902-442f-b1fe-4561e7a64517 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:19.806827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de84ec-f902-442f-b1fe-4561e7a64517 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:19.806827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de84ec-f902-442f-b1fe-4561e7a64517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:19.806827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de84ec-f902-442f-b1fe-4561e7a64517 None admin] RBAC: Adding query filter params (role.id=41a3de4f5213430bb14205f0f3aabadc, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=b428f7d0d62049cf8fbbd05830d0d356) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:19.806827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de84ec-f902-442f-b1fe-4561e7a64517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:19.806827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de84ec-f902-442f-b1fe-4561e7a64517 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:19.811495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 270/543] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:19 2022] GET /identity/v3/role_assignments?user.id=b428f7d0d62049cf8fbbd05830d0d356&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=41a3de4f5213430bb14205f0f3aabadc => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:19.841545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cb52d-0a8e-45f8-9ef2-53acb0ac81e7 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:19.841829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cb52d-0a8e-45f8-9ef2-53acb0ac81e7 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:19.842109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cb52d-0a8e-45f8-9ef2-53acb0ac81e7 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:19.843812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 271/544] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:19.849444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a3a43-609f-4a5e-bb72-b698ddbcceb2 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:19.849731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a3a43-609f-4a5e-bb72-b698ddbcceb2 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:19.850008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a3a43-609f-4a5e-bb72-b698ddbcceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:19.891120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-972a3a43-609f-4a5e-bb72-b698ddbcceb2 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:19.892447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-972a3a43-609f-4a5e-bb72-b698ddbcceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:19.930592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:19.942934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8620d-4615-4803-8936-d97d448d2cd7 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:19.998806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 272/545] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:25:20.013853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d7eb1-2098-43ee-a245-7d580c97db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:20.014520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d7eb1-2098-43ee-a245-7d580c97db91 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:20.014803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d7eb1-2098-43ee-a245-7d580c97db91 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:20.015077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d7eb1-2098-43ee-a245-7d580c97db91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:20.032427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d7eb1-2098-43ee-a245-7d580c97db91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-735d7eb1-2098-43ee-a245-7d580c97db91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:20.037970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:20.039255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:20.040597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:20.040597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:20.040597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:20.040597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:20.040597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:20.040597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:20.040597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:20.040597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:20.040597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:20.040597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:20.040597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:20.040597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:20.040597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 274/546] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:20.043362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a3a43-609f-4a5e-bb72-b698ddbcceb2 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:20.044657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d7eb1-2098-43ee-a245-7d580c97db91 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:20.153699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:20.163387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d7eb1-2098-43ee-a245-7d580c97db91 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:20.220488 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a840651-d2bb-4cec-a8ac-f07b698cd130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:20.221116 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a840651-d2bb-4cec-a8ac-f07b698cd130 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:20.221396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a840651-d2bb-4cec-a8ac-f07b698cd130 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:20.221696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a840651-d2bb-4cec-a8ac-f07b698cd130 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:20.222955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a840651-d2bb-4cec-a8ac-f07b698cd130 None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:20.223261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a840651-d2bb-4cec-a8ac-f07b698cd130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:20.229099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a840651-d2bb-4cec-a8ac-f07b698cd130 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:20.251244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 275/547] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:20.254340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a840651-d2bb-4cec-a8ac-f07b698cd130 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:20.290201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a3a43-609f-4a5e-bb72-b698ddbcceb2 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:20.356289 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0734aed-0a94-43cd-91ec-b2794c415f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:20.357532 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0734aed-0a94-43cd-91ec-b2794c415f1c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:20.357532 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0734aed-0a94-43cd-91ec-b2794c415f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:20.357532 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0734aed-0a94-43cd-91ec-b2794c415f1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:20.376948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0734aed-0a94-43cd-91ec-b2794c415f1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-b0734aed-0a94-43cd-91ec-b2794c415f1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:20.382500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:20.383458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:20.384303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:20.384303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:20.384303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:20.384303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:20.384303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:20.384303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:20.384303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:20.384303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:20.384303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:20.384303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:20.384303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:20.384303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:20.392194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 273/548] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:20.399355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a840651-d2bb-4cec-a8ac-f07b698cd130 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:20.400775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0734aed-0a94-43cd-91ec-b2794c415f1c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:20.441522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:20.449059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f2498-516d-4582-ad0e-2012a0cec164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:20.449765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f2498-516d-4582-ad0e-2012a0cec164 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:20.450051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f2498-516d-4582-ad0e-2012a0cec164 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:20.450325 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f2498-516d-4582-ad0e-2012a0cec164 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:20.473324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f2498-516d-4582-ad0e-2012a0cec164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:20.474818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f2498-516d-4582-ad0e-2012a0cec164 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-a91f2498-516d-4582-ad0e-2012a0cec164 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:20.502003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:20.503799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:20.504675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:20.504675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:20.504675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:20.504675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:20.510842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 276/549] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:20.516217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f2498-516d-4582-ad0e-2012a0cec164 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:20.522413 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:20.595805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0734aed-0a94-43cd-91ec-b2794c415f1c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:20.640053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1e9c6-3c6d-458f-b7d5-ec116832ecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:20.640702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1e9c6-3c6d-458f-b7d5-ec116832ecaa None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:20.640956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1e9c6-3c6d-458f-b7d5-ec116832ecaa None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:20.641244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1e9c6-3c6d-458f-b7d5-ec116832ecaa None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:20.641955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1e9c6-3c6d-458f-b7d5-ec116832ecaa None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:20.642263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1e9c6-3c6d-458f-b7d5-ec116832ecaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:20.643674 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1e9c6-3c6d-458f-b7d5-ec116832ecaa None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:20.671007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 274/550] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:20.679318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1e9c6-3c6d-458f-b7d5-ec116832ecaa None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:20.686365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f2498-516d-4582-ad0e-2012a0cec164 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:20.733689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7105ab-f3bd-455e-8f86-65f1833a6155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:20.734690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7105ab-f3bd-455e-8f86-65f1833a6155 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:20.735230 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7105ab-f3bd-455e-8f86-65f1833a6155 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:20.735714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7105ab-f3bd-455e-8f86-65f1833a6155 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:20.736699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7105ab-f3bd-455e-8f86-65f1833a6155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:20.737879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7105ab-f3bd-455e-8f86-65f1833a6155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:20.739554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7105ab-f3bd-455e-8f86-65f1833a6155 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:20.764150 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 277/551] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:20.769390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7105ab-f3bd-455e-8f86-65f1833a6155 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:20.790526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:20.811347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1e9c6-3c6d-458f-b7d5-ec116832ecaa None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:20.853327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ca0be-8a0d-4e86-9b6b-2f6e253b65cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:20.853982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ca0be-8a0d-4e86-9b6b-2f6e253b65cf None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:20.854266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ca0be-8a0d-4e86-9b6b-2f6e253b65cf None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:20.854544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ca0be-8a0d-4e86-9b6b-2f6e253b65cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:20.873418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ca0be-8a0d-4e86-9b6b-2f6e253b65cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:20.874883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ca0be-8a0d-4e86-9b6b-2f6e253b65cf None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:20.882967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-144ca0be-8a0d-4e86-9b6b-2f6e253b65cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:20.909678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:20.911088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:20.912675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:20.912675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:20.912675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:20.912675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:20.912902 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 275/552] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:20.918060 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ca0be-8a0d-4e86-9b6b-2f6e253b65cf None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:20.957739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7105ab-f3bd-455e-8f86-65f1833a6155 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:20.999156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c7d8a-ed92-48bc-b901-45dd1e795189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:20.999882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c7d8a-ed92-48bc-b901-45dd1e795189 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:21.000172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c7d8a-ed92-48bc-b901-45dd1e795189 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:21.000450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c7d8a-ed92-48bc-b901-45dd1e795189 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:21.009146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c7d8a-ed92-48bc-b901-45dd1e795189 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:21.011721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c7d8a-ed92-48bc-b901-45dd1e795189 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-8e4c7d8a-ed92-48bc-b901-45dd1e795189 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:21.024318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:21.026439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:21.028703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:21.028703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:21.028703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:21.028703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:21.028703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:21.028703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:21.028703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:21.028703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:21.028703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 21:25:21.028703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:21.028703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 278/553] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:25:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:21.035771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c7d8a-ed92-48bc-b901-45dd1e795189 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:21.052437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ca0be-8a0d-4e86-9b6b-2f6e253b65cf None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:21.082939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:21.088143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b06c39-1306-4a97-8701-1a56f0008401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:21.088769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b06c39-1306-4a97-8701-1a56f0008401 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:21.089052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b06c39-1306-4a97-8701-1a56f0008401 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:21.089329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b06c39-1306-4a97-8701-1a56f0008401 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:21.090029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b06c39-1306-4a97-8701-1a56f0008401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:21.090392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b06c39-1306-4a97-8701-1a56f0008401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:21.091799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b06c39-1306-4a97-8701-1a56f0008401 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:21.104877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 276/554] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:21.116881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b06c39-1306-4a97-8701-1a56f0008401 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:21.146795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c7d8a-ed92-48bc-b901-45dd1e795189 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:21.171375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:21.190362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a6ad6-cac0-4b1b-a2d2-11c7867fb010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:21.190995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a6ad6-cac0-4b1b-a2d2-11c7867fb010 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:21.192262 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a6ad6-cac0-4b1b-a2d2-11c7867fb010 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:21.192555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a6ad6-cac0-4b1b-a2d2-11c7867fb010 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:21.193959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a6ad6-cac0-4b1b-a2d2-11c7867fb010 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:21.194278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a6ad6-cac0-4b1b-a2d2-11c7867fb010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:21.197148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a6ad6-cac0-4b1b-a2d2-11c7867fb010 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:21.237080 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 279/555] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 25 21:25:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:21.240040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a6ad6-cac0-4b1b-a2d2-11c7867fb010 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:21.319007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b06c39-1306-4a97-8701-1a56f0008401 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:21.361110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ae9ca-0f9f-43a3-a6b2-c7d089b79a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:21.361779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae9ca-0f9f-43a3-a6b2-c7d089b79a18 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:21.362069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae9ca-0f9f-43a3-a6b2-c7d089b79a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:21.362396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ae9ca-0f9f-43a3-a6b2-c7d089b79a18 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:21.370530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ae9ca-0f9f-43a3-a6b2-c7d089b79a18 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:21.372071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ae9ca-0f9f-43a3-a6b2-c7d089b79a18 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-aa8ae9ca-0f9f-43a3-a6b2-c7d089b79a18 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:21.385404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:21.387582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:21.390354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:21.390354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:21.390354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:21.390354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:21.390354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:21.390354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:21.390354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:21.390354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:21.390354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:25:21.390354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:21.390354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 277/556] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 21:25:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:21.395765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a2e20-e139-4384-a7a7-d6131798b3ac None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:21.395765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a2e20-e139-4384-a7a7-d6131798b3ac None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:21.395765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a2e20-e139-4384-a7a7-d6131798b3ac None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:21.395765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 278/557] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:21.396432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a2e20-e139-4384-a7a7-d6131798b3ac None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:21.409687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a6ad6-cac0-4b1b-a2d2-11c7867fb010 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:21.448840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587c154-d5bf-44f7-9ce1-6f496bac6189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:21.449663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587c154-d5bf-44f7-9ce1-6f496bac6189 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:21.450020 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587c154-d5bf-44f7-9ce1-6f496bac6189 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:21.450365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587c154-d5bf-44f7-9ce1-6f496bac6189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:21.476142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:21.513879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:21.516435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a2e20-e139-4384-a7a7-d6131798b3ac None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:21.541862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587c154-d5bf-44f7-9ce1-6f496bac6189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:21.544476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587c154-d5bf-44f7-9ce1-6f496bac6189 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:21.556741 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa20a3a-235a-4793-a298-84ce25069e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:21.557575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa20a3a-235a-4793-a298-84ce25069e9a None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:21.558403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa20a3a-235a-4793-a298-84ce25069e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:21.558860 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa20a3a-235a-4793-a298-84ce25069e9a None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:21.560171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa20a3a-235a-4793-a298-84ce25069e9a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:21.560913 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa20a3a-235a-4793-a298-84ce25069e9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:21.562779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa20a3a-235a-4793-a298-84ce25069e9a None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:21.617458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 279/558] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 21:25:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:21.619000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c4f72-a982-4c6e-893c-c4ee30de6277 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:21.619460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c4f72-a982-4c6e-893c-c4ee30de6277 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:21.619911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c4f72-a982-4c6e-893c-c4ee30de6277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:21.644139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-872c4f72-a982-4c6e-893c-c4ee30de6277 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:21.645850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-872c4f72-a982-4c6e-893c-c4ee30de6277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:21.696337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 280/559] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:25:21.697370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587c154-d5bf-44f7-9ce1-6f496bac6189 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:21.751764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 280/560] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:21.751764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c4f72-a982-4c6e-893c-c4ee30de6277 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:21.795304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:21.804760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:21.825102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587c154-d5bf-44f7-9ce1-6f496bac6189 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:21.860852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c4f72-a982-4c6e-893c-c4ee30de6277 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:21.863465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433486b-2577-4a8b-aa4b-d740c25f3b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:21.864146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433486b-2577-4a8b-aa4b-d740c25f3b51 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:21.865209 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433486b-2577-4a8b-aa4b-d740c25f3b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:21.865508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433486b-2577-4a8b-aa4b-d740c25f3b51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:21.877074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433486b-2577-4a8b-aa4b-d740c25f3b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:21.878511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433486b-2577-4a8b-aa4b-d740c25f3b51 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2433486b-2577-4a8b-aa4b-d740c25f3b51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:21.894592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:21.895700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:21.896757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:21.896757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:21.896757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:21.896757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:21.896757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 281/561] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:21.897266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99e0b-2889-4626-a7f2-f54b62867b01 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:21.897552 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99e0b-2889-4626-a7f2-f54b62867b01 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:21.897828 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99e0b-2889-4626-a7f2-f54b62867b01 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:21.899225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 282/562] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:21.900651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c99e0b-2889-4626-a7f2-f54b62867b01 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:21.905444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff681a-cff8-4b1b-916e-d216758df0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:21.906098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff681a-cff8-4b1b-916e-d216758df0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:21.906385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff681a-cff8-4b1b-916e-d216758df0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:21.906663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff681a-cff8-4b1b-916e-d216758df0b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:21.917938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff681a-cff8-4b1b-916e-d216758df0b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:21.919386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff681a-cff8-4b1b-916e-d216758df0b5 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-eaff681a-cff8-4b1b-916e-d216758df0b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:21.934648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:21.935546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:21.936757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:21.936757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:21.936757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:21.936757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:21.936757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 281/563] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:21.936757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff681a-cff8-4b1b-916e-d216758df0b5 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:22.016885 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c99e0b-2889-4626-a7f2-f54b62867b01 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:22.052838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f56493-2f50-415d-a1b7-b110ca3d209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:22.053482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f56493-2f50-415d-a1b7-b110ca3d209d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:22.053768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f56493-2f50-415d-a1b7-b110ca3d209d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:22.054047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f56493-2f50-415d-a1b7-b110ca3d209d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:22.054659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:22.055944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:22.063872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff681a-cff8-4b1b-916e-d216758df0b5 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:22.065597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f56493-2f50-415d-a1b7-b110ca3d209d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b9f56493-2f50-415d-a1b7-b110ca3d209d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:22.070617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:22.071524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:22.072400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:22.072400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:22.072400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:22.072400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:22.072400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:22.072400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:22.072400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:22.072400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:22.072400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:22.072400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:22.072400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:22.072400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:22.072400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 283/564] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:22.073547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6f9f1-f65b-4c3c-b837-ee2d44977127 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:22.073720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6f9f1-f65b-4c3c-b837-ee2d44977127 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:22.073987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6f9f1-f65b-4c3c-b837-ee2d44977127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:22.092480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-78a6f9f1-f65b-4c3c-b837-ee2d44977127 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:22.093756 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-78a6f9f1-f65b-4c3c-b837-ee2d44977127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:22.108016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faef82a-0e14-437a-b212-99568db1f627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:22.108638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faef82a-0e14-437a-b212-99568db1f627 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:22.108945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faef82a-0e14-437a-b212-99568db1f627 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:22.109309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faef82a-0e14-437a-b212-99568db1f627 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:22.110237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faef82a-0e14-437a-b212-99568db1f627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:22.110542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faef82a-0e14-437a-b212-99568db1f627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:22.112241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faef82a-0e14-437a-b212-99568db1f627 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:22.125744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 282/565] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:22.126600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faef82a-0e14-437a-b212-99568db1f627 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:22.183849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 284/566] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:22.183849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6f9f1-f65b-4c3c-b837-ee2d44977127 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:22.250204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faef82a-0e14-437a-b212-99568db1f627 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:22.287609 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01540b4e-fdfe-4439-8cf8-631463c2224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:22.288260 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01540b4e-fdfe-4439-8cf8-631463c2224f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:22.288541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01540b4e-fdfe-4439-8cf8-631463c2224f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:22.288812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01540b4e-fdfe-4439-8cf8-631463c2224f None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:22.289499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01540b4e-fdfe-4439-8cf8-631463c2224f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:22.289803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01540b4e-fdfe-4439-8cf8-631463c2224f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:22.290254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6f9f1-f65b-4c3c-b837-ee2d44977127 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:22.291163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01540b4e-fdfe-4439-8cf8-631463c2224f None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:22.303040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 283/567] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:22.303871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01540b4e-fdfe-4439-8cf8-631463c2224f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:22.314211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:22.321188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:22.325974 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e85063-5756-48dd-a6d4-ce90f2795dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:22.326594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e85063-5756-48dd-a6d4-ce90f2795dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:22.326876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e85063-5756-48dd-a6d4-ce90f2795dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:22.334208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e85063-5756-48dd-a6d4-ce90f2795dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:22.334208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e85063-5756-48dd-a6d4-ce90f2795dd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:22.334208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e85063-5756-48dd-a6d4-ce90f2795dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:22.334208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e85063-5756-48dd-a6d4-ce90f2795dd0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:22.337663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 285/568] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:22.338580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e85063-5756-48dd-a6d4-ce90f2795dd0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:22.405106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01540b4e-fdfe-4439-8cf8-631463c2224f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:22.438791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da900e-2c6a-4fcc-9306-082c5f0bb3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:22.439228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e85063-5756-48dd-a6d4-ce90f2795dd0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:22.439359 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da900e-2c6a-4fcc-9306-082c5f0bb3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:22.439641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da900e-2c6a-4fcc-9306-082c5f0bb3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:22.439948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da900e-2c6a-4fcc-9306-082c5f0bb3a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:22.448328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da900e-2c6a-4fcc-9306-082c5f0bb3a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:22.449777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da900e-2c6a-4fcc-9306-082c5f0bb3a7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-54da900e-2c6a-4fcc-9306-082c5f0bb3a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:22.461066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:22.462155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:22.463383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:22.463383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:22.463383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:22.463383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:22.463383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:22.463383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:22.463383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:22.463383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:22.463383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 284/569] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:22.464038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e84b-4af4-4e5a-8165-ff4cf40133d3 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:22.464038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e84b-4af4-4e5a-8165-ff4cf40133d3 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:22.464272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e84b-4af4-4e5a-8165-ff4cf40133d3 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:22.466021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 285/570] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:22.466400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22e84b-4af4-4e5a-8165-ff4cf40133d3 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:22.477548 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b69d74-f94d-4cf8-bf93-9d73529fb0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:22.478275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69d74-f94d-4cf8-bf93-9d73529fb0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:22.478564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69d74-f94d-4cf8-bf93-9d73529fb0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:22.478841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69d74-f94d-4cf8-bf93-9d73529fb0c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:22.489663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b69d74-f94d-4cf8-bf93-9d73529fb0c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b4b69d74-f94d-4cf8-bf93-9d73529fb0c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:22.495011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:22.495957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:22.496797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:22.496797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:22.496797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:22.496797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:22.496797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:22.496797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:22.496797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:22.496797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:22.496797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:22.496797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:22.496797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:22.496797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:22.496797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 286/571] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:22.498113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b69d74-f94d-4cf8-bf93-9d73529fb0c7 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:22.541087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:22.543353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:22.571323 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22e84b-4af4-4e5a-8165-ff4cf40133d3 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:22.596281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b69d74-f94d-4cf8-bf93-9d73529fb0c7 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:22.605853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810b2b4-0520-438b-b13b-06b264d89b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:22.606486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810b2b4-0520-438b-b13b-06b264d89b47 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:22.606765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810b2b4-0520-438b-b13b-06b264d89b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:22.607107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810b2b4-0520-438b-b13b-06b264d89b47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:22.614693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810b2b4-0520-438b-b13b-06b264d89b47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:22.616163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810b2b4-0520-438b-b13b-06b264d89b47 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-a810b2b4-0520-438b-b13b-06b264d89b47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:22.627404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:22.628949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:22.629823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:22.629823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:22.629823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:22.629823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:22.629823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:22.629823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:22.629823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:22.629823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:22.629823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 286/572] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:22.630299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810b2b4-0520-438b-b13b-06b264d89b47 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:22.634907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea675e5b-be38-41e9-8ee6-5bf8217bbe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:22.635549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea675e5b-be38-41e9-8ee6-5bf8217bbe07 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:22.635862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea675e5b-be38-41e9-8ee6-5bf8217bbe07 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:22.636140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea675e5b-be38-41e9-8ee6-5bf8217bbe07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:22.647312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea675e5b-be38-41e9-8ee6-5bf8217bbe07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:22.648789 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea675e5b-be38-41e9-8ee6-5bf8217bbe07 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ea675e5b-be38-41e9-8ee6-5bf8217bbe07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:22.664028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:22.664884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:22.665777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:22.665777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:22.665777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:22.665777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:22.665777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 287/573] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:22.666319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66197f-4145-42a3-8ff0-1a0ff9f745bf None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:22.666558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66197f-4145-42a3-8ff0-1a0ff9f745bf None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:22.666829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66197f-4145-42a3-8ff0-1a0ff9f745bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:22.685248 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-aa66197f-4145-42a3-8ff0-1a0ff9f745bf None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:22.686449 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-aa66197f-4145-42a3-8ff0-1a0ff9f745bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:22.733551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810b2b4-0520-438b-b13b-06b264d89b47 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:22.760049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 288/574] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:22.760922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66197f-4145-42a3-8ff0-1a0ff9f745bf None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:22.763333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:22.768288 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e149af-4f23-4c82-a467-8b87c33998c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:22.769452 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e149af-4f23-4c82-a467-8b87c33998c3 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:22.769736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e149af-4f23-4c82-a467-8b87c33998c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:22.770011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e149af-4f23-4c82-a467-8b87c33998c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:22.770767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e149af-4f23-4c82-a467-8b87c33998c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:22.771076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e149af-4f23-4c82-a467-8b87c33998c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:22.772605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e149af-4f23-4c82-a467-8b87c33998c3 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:22.784554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 287/575] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:22.785366 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e149af-4f23-4c82-a467-8b87c33998c3 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:22.791425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:22.863993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66197f-4145-42a3-8ff0-1a0ff9f745bf None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:22.885273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e149af-4f23-4c82-a467-8b87c33998c3 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:22.898355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14362b39-2eed-405d-b8ed-0bdfe7a3f9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:22.899157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14362b39-2eed-405d-b8ed-0bdfe7a3f9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:22.899598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14362b39-2eed-405d-b8ed-0bdfe7a3f9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:22.899922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14362b39-2eed-405d-b8ed-0bdfe7a3f9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:22.900650 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14362b39-2eed-405d-b8ed-0bdfe7a3f9a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:22.900960 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14362b39-2eed-405d-b8ed-0bdfe7a3f9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:22.902334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14362b39-2eed-405d-b8ed-0bdfe7a3f9a8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:22.915076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 289/576] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:22.915076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14362b39-2eed-405d-b8ed-0bdfe7a3f9a8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:22.922951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7543d-d578-4bb2-8d47-aac419492961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:22.923573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7543d-d578-4bb2-8d47-aac419492961 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:22.923887 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7543d-d578-4bb2-8d47-aac419492961 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:22.924167 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7543d-d578-4bb2-8d47-aac419492961 None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:22.925014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7543d-d578-4bb2-8d47-aac419492961 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:22.925321 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7543d-d578-4bb2-8d47-aac419492961 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:22.926742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7543d-d578-4bb2-8d47-aac419492961 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:22.938094 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 288/577] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:22.938903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7543d-d578-4bb2-8d47-aac419492961 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:22.993291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:23.001147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:23.011449 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14362b39-2eed-405d-b8ed-0bdfe7a3f9a8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:23.040847 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7543d-d578-4bb2-8d47-aac419492961 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:23.046877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc832e-d008-429f-8d49-c3c0a19e0077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:23.047489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc832e-d008-429f-8d49-c3c0a19e0077 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:23.047844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc832e-d008-429f-8d49-c3c0a19e0077 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:23.048119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc832e-d008-429f-8d49-c3c0a19e0077 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:23.048814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc832e-d008-429f-8d49-c3c0a19e0077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:23.049118 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc832e-d008-429f-8d49-c3c0a19e0077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:23.051298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc832e-d008-429f-8d49-c3c0a19e0077 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:23.062366 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 290/578] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:23.064591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc832e-d008-429f-8d49-c3c0a19e0077 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:23.075780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6849605-ae49-417e-8005-58617e259f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:23.076419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6849605-ae49-417e-8005-58617e259f03 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:23.076701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6849605-ae49-417e-8005-58617e259f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:23.076980 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6849605-ae49-417e-8005-58617e259f03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:23.087055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6849605-ae49-417e-8005-58617e259f03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-e6849605-ae49-417e-8005-58617e259f03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:23.092412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:23.093320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:23.094189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:23.094189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:23.094189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:23.094189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:23.094189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:23.094189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:23.094189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:23.094189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:23.094189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:23.094189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:23.094189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:23.094189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:23.094189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 289/579] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:23.094903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6849605-ae49-417e-8005-58617e259f03 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:23.170479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc832e-d008-429f-8d49-c3c0a19e0077 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:23.192678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6849605-ae49-417e-8005-58617e259f03 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:23.204570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2d451-f745-4ec7-8cf3-fc6ef9f9220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:23.205239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2d451-f745-4ec7-8cf3-fc6ef9f9220d None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:23.205361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:23.205525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2d451-f745-4ec7-8cf3-fc6ef9f9220d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:23.205803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2d451-f745-4ec7-8cf3-fc6ef9f9220d None admin] PATH_INFO: `/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/7d3d6613476c445b82302df5025f3ce6/roles/41a3de4f5213430bb14205f0f3aabadc` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:23.221308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2d451-f745-4ec7-8cf3-fc6ef9f9220d None admin] RBAC: Authorizing `identity:create_grant(project_id=48d9c81feed744bb9e322910711a0d3b, user_id=7d3d6613476c445b82302df5025f3ce6, role_id=41a3de4f5213430bb14205f0f3aabadc)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:23.223328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2d451-f745-4ec7-8cf3-fc6ef9f9220d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:23.227733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dd53b-4090-4427-9ef9-b5363a566b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:23.228425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dd53b-4090-4427-9ef9-b5363a566b36 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:23.228708 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dd53b-4090-4427-9ef9-b5363a566b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:23.228985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dd53b-4090-4427-9ef9-b5363a566b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:23.239571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0dd53b-4090-4427-9ef9-b5363a566b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:23.244826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0dd53b-4090-4427-9ef9-b5363a566b36 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-bf0dd53b-4090-4427-9ef9-b5363a566b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:23.255009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:23.261233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:23.262379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:23.262379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:23.262379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:23.262379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:23.262379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 290/580] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:23.262379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dd53b-4090-4427-9ef9-b5363a566b36 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:23.277350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:23.281987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 291/581] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:25:23 2022] PUT /identity/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/7d3d6613476c445b82302df5025f3ce6/roles/41a3de4f5213430bb14205f0f3aabadc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:25:23.282794 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2d451-f745-4ec7-8cf3-fc6ef9f9220d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:23.371340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dd53b-4090-4427-9ef9-b5363a566b36 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:23.398516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2d451-f745-4ec7-8cf3-fc6ef9f9220d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:23.409670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b56cf-196e-4d83-bc83-71885c460775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:23.410296 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b56cf-196e-4d83-bc83-71885c460775 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:23.410570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b56cf-196e-4d83-bc83-71885c460775 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:23.410998 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b56cf-196e-4d83-bc83-71885c460775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:23.412099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b56cf-196e-4d83-bc83-71885c460775 None admin] RBAC: Adding query filter params (role.id=41a3de4f5213430bb14205f0f3aabadc, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=4c4863a61a484ed4b0dac01e908cd05a) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:23.412407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b56cf-196e-4d83-bc83-71885c460775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:23.413896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b56cf-196e-4d83-bc83-71885c460775 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:23.431772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 291/582] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:23 2022] GET /identity/v3/role_assignments?user.id=4c4863a61a484ed4b0dac01e908cd05a&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=41a3de4f5213430bb14205f0f3aabadc => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:23.431772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b56cf-196e-4d83-bc83-71885c460775 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:23.440021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1d659-1745-4097-b3c4-755f7f98b011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:23.441473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1d659-1745-4097-b3c4-755f7f98b011 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:23.441935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1d659-1745-4097-b3c4-755f7f98b011 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:23.442334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1d659-1745-4097-b3c4-755f7f98b011 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:23.455210 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1d659-1745-4097-b3c4-755f7f98b011 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:23.458382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1d659-1745-4097-b3c4-755f7f98b011 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-70f1d659-1745-4097-b3c4-755f7f98b011 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:23.472579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:23.473720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:23.474681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:23.474681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:23.474681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:23.474681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:23.474681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:23.474681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:23.474681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:23.474681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:23.474681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:25:23.474681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:23.475199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:23.475271 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 292/583] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:23.476319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1d659-1745-4097-b3c4-755f7f98b011 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:23.573882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b56cf-196e-4d83-bc83-71885c460775 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:23.578952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:23.661851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1d659-1745-4097-b3c4-755f7f98b011 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:23.662818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692432c0-c985-4ee2-b429-16458adb5c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:23.663684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692432c0-c985-4ee2-b429-16458adb5c43 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:23.664083 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692432c0-c985-4ee2-b429-16458adb5c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:23.665199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692432c0-c985-4ee2-b429-16458adb5c43 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:23.665938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692432c0-c985-4ee2-b429-16458adb5c43 None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:23.666250 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692432c0-c985-4ee2-b429-16458adb5c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:23.667645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692432c0-c985-4ee2-b429-16458adb5c43 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:23.682426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 292/584] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:23.683587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692432c0-c985-4ee2-b429-16458adb5c43 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:23.714603 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49956750-d900-45c6-9ab9-5bbf46bbdca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:23.715323 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49956750-d900-45c6-9ab9-5bbf46bbdca2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:23.715626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49956750-d900-45c6-9ab9-5bbf46bbdca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:23.715963 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49956750-d900-45c6-9ab9-5bbf46bbdca2 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:23.716722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49956750-d900-45c6-9ab9-5bbf46bbdca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:23.717036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49956750-d900-45c6-9ab9-5bbf46bbdca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:23.718656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49956750-d900-45c6-9ab9-5bbf46bbdca2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:23.732623 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 293/585] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:23.733243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49956750-d900-45c6-9ab9-5bbf46bbdca2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:23.783621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:23.793350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692432c0-c985-4ee2-b429-16458adb5c43 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:23.829803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360a3ed-d339-476e-9b49-cd237b231c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:23.830235 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360a3ed-d339-476e-9b49-cd237b231c5a None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:23.830940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360a3ed-d339-476e-9b49-cd237b231c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:23.831783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360a3ed-d339-476e-9b49-cd237b231c5a None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:23.832446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360a3ed-d339-476e-9b49-cd237b231c5a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:23.833051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360a3ed-d339-476e-9b49-cd237b231c5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:23.834797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360a3ed-d339-476e-9b49-cd237b231c5a None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:23.852477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49956750-d900-45c6-9ab9-5bbf46bbdca2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:23.856189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 293/586] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 25 21:25:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:23.857147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360a3ed-d339-476e-9b49-cd237b231c5a None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:23.877264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:23.901850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5e81f-ebe6-4910-8d7c-2e7cc1165315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:23.902837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5e81f-ebe6-4910-8d7c-2e7cc1165315 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:23.903305 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5e81f-ebe6-4910-8d7c-2e7cc1165315 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:23.903794 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5e81f-ebe6-4910-8d7c-2e7cc1165315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:23.917499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5e81f-ebe6-4910-8d7c-2e7cc1165315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:23.919290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5e81f-ebe6-4910-8d7c-2e7cc1165315 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-73f5e81f-ebe6-4910-8d7c-2e7cc1165315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:23.937370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:23.938290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:23.939175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:23.939175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:23.939175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:23.939175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:23.942014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 294/587] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:23.943223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5e81f-ebe6-4910-8d7c-2e7cc1165315 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:23.974452 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360a3ed-d339-476e-9b49-cd237b231c5a None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:24.012387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e3c8b-dadc-47e8-ba7a-088a50305f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:24.013102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e3c8b-dadc-47e8-ba7a-088a50305f25 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:24.013387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e3c8b-dadc-47e8-ba7a-088a50305f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:24.013659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e3c8b-dadc-47e8-ba7a-088a50305f25 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:24.022241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e3c8b-dadc-47e8-ba7a-088a50305f25 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:24.023438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e3c8b-dadc-47e8-ba7a-088a50305f25 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-a62e3c8b-dadc-47e8-ba7a-088a50305f25 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:24.037443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:24.038424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:24.039347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:24.039347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:24.039347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:24.039347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:24.039347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:24.039347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:24.039347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:24.039347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:24.039347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:25:24.039347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:24.039347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 294/588] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:24.039958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e3c8b-dadc-47e8-ba7a-088a50305f25 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:24.055130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:24.060175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5e81f-ebe6-4910-8d7c-2e7cc1165315 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:24.103954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd667412-519d-4149-961d-40cb197d95cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:24.104524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd667412-519d-4149-961d-40cb197d95cc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:24.104808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd667412-519d-4149-961d-40cb197d95cc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:24.105085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd667412-519d-4149-961d-40cb197d95cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:24.118827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd667412-519d-4149-961d-40cb197d95cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:24.120501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd667412-519d-4149-961d-40cb197d95cc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-dd667412-519d-4149-961d-40cb197d95cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:24.139410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:24.140587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:24.141610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:24.141610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:24.141610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:24.141610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:24.141610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 295/589] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:24.141889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd667412-519d-4149-961d-40cb197d95cc None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:24.173533 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e3c8b-dadc-47e8-ba7a-088a50305f25 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:24.177913 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:24.210983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e71de-1502-4f63-8edd-ee41be671736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:24.211543 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e71de-1502-4f63-8edd-ee41be671736 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:24.211909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e71de-1502-4f63-8edd-ee41be671736 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:24.212196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e71de-1502-4f63-8edd-ee41be671736 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:24.212910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e71de-1502-4f63-8edd-ee41be671736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:24.213225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e71de-1502-4f63-8edd-ee41be671736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:24.214603 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e71de-1502-4f63-8edd-ee41be671736 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:24.227655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 295/590] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:24.228585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e71de-1502-4f63-8edd-ee41be671736 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:24.269636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd667412-519d-4149-961d-40cb197d95cc None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:24.305743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30a94-26c7-40a3-ab20-3ccea99b342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:24.306373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30a94-26c7-40a3-ab20-3ccea99b342d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:24.306659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30a94-26c7-40a3-ab20-3ccea99b342d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:24.306939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30a94-26c7-40a3-ab20-3ccea99b342d None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:24.307734 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30a94-26c7-40a3-ab20-3ccea99b342d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:24.308083 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30a94-26c7-40a3-ab20-3ccea99b342d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:24.309514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30a94-26c7-40a3-ab20-3ccea99b342d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:24.317238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:24.328396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 296/591] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 25 21:25:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:24.328982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30a94-26c7-40a3-ab20-3ccea99b342d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:24.360577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e71de-1502-4f63-8edd-ee41be671736 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:24.397589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087e9f6-de36-4833-8d42-16f679ec5135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:24.398439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087e9f6-de36-4833-8d42-16f679ec5135 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:24.398883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087e9f6-de36-4833-8d42-16f679ec5135 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:24.399307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087e9f6-de36-4833-8d42-16f679ec5135 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:24.400195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087e9f6-de36-4833-8d42-16f679ec5135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:24.400644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087e9f6-de36-4833-8d42-16f679ec5135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:24.402151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087e9f6-de36-4833-8d42-16f679ec5135 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:24.414825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 296/592] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:24.415947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087e9f6-de36-4833-8d42-16f679ec5135 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:24.423600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:24.445201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30a94-26c7-40a3-ab20-3ccea99b342d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:24.483523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79e6b7-10d0-4e51-929e-24777c45c900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:24.484204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e6b7-10d0-4e51-929e-24777c45c900 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:24.484495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e6b7-10d0-4e51-929e-24777c45c900 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:24.484772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79e6b7-10d0-4e51-929e-24777c45c900 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:24.492952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79e6b7-10d0-4e51-929e-24777c45c900 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:24.494409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79e6b7-10d0-4e51-929e-24777c45c900 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ba79e6b7-10d0-4e51-929e-24777c45c900 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:24.506797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:24.508057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:24.509194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:24.509194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:24.509194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:24.509194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:24.509194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:24.509194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:24.509194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:24.509194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:24.509194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:25:24.509194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:24.510263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 297/593] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:24.511174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79e6b7-10d0-4e51-929e-24777c45c900 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:24.538073 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087e9f6-de36-4833-8d42-16f679ec5135 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:24.581785 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:24.594018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec18e1-de07-4d18-a438-c70c78677f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:24.594680 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec18e1-de07-4d18-a438-c70c78677f25 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:24.594954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec18e1-de07-4d18-a438-c70c78677f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:24.595223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec18e1-de07-4d18-a438-c70c78677f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:24.607981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec18e1-de07-4d18-a438-c70c78677f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:24.609991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec18e1-de07-4d18-a438-c70c78677f25 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-2eec18e1-de07-4d18-a438-c70c78677f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:24.625676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:24.626759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:24.628518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:24.628518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:24.628518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:24.628518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:24.629966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 297/594] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:24.634994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec18e1-de07-4d18-a438-c70c78677f25 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:24.657984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79e6b7-10d0-4e51-929e-24777c45c900 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:24.716821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324760f-6f26-4d28-925b-39bbb3f058fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:24.717680 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324760f-6f26-4d28-925b-39bbb3f058fa None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:24.718143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324760f-6f26-4d28-925b-39bbb3f058fa None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:24.718562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324760f-6f26-4d28-925b-39bbb3f058fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:24.728234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324760f-6f26-4d28-925b-39bbb3f058fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:24.730566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324760f-6f26-4d28-925b-39bbb3f058fa None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-c324760f-6f26-4d28-925b-39bbb3f058fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:24.747460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:24.748551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:24.749629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:24.749629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:24.749629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:24.749629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:24.749629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:24.749629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:24.749629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:24.749629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:24.751390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec18e1-de07-4d18-a438-c70c78677f25 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:24.751775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 298/595] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:24.752781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324760f-6f26-4d28-925b-39bbb3f058fa None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:24.759777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:24.790001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239508c-7fdb-44a0-a502-18bbe3b34663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:24.790762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239508c-7fdb-44a0-a502-18bbe3b34663 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:24.791133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239508c-7fdb-44a0-a502-18bbe3b34663 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:24.791503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239508c-7fdb-44a0-a502-18bbe3b34663 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:24.792422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239508c-7fdb-44a0-a502-18bbe3b34663 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:24.792824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239508c-7fdb-44a0-a502-18bbe3b34663 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:24.794347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239508c-7fdb-44a0-a502-18bbe3b34663 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:24.818574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 298/596] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Jul 25 21:25:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:24.819638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239508c-7fdb-44a0-a502-18bbe3b34663 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:24.865437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:24.869292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324760f-6f26-4d28-925b-39bbb3f058fa None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:24.905241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1049c5-0595-4e2e-89df-97fcca4069e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:24.906142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1049c5-0595-4e2e-89df-97fcca4069e4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:24.906569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1049c5-0595-4e2e-89df-97fcca4069e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:24.907010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1049c5-0595-4e2e-89df-97fcca4069e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:24.907892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1049c5-0595-4e2e-89df-97fcca4069e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:24.908342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1049c5-0595-4e2e-89df-97fcca4069e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:24.911817 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1049c5-0595-4e2e-89df-97fcca4069e4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:24.926369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 299/597] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:24.927518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1049c5-0595-4e2e-89df-97fcca4069e4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:24.934401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239508c-7fdb-44a0-a502-18bbe3b34663 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:24.971173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5c072-a013-4749-8bc5-d0911304e92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:24.972417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5c072-a013-4749-8bc5-d0911304e92a None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:24.972702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5c072-a013-4749-8bc5-d0911304e92a None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:24.972973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5c072-a013-4749-8bc5-d0911304e92a None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:24.973728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5c072-a013-4749-8bc5-d0911304e92a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:24.974023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5c072-a013-4749-8bc5-d0911304e92a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:24.975440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5c072-a013-4749-8bc5-d0911304e92a None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:24.988189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 299/598] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:24.989136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5c072-a013-4749-8bc5-d0911304e92a None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:25.000119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:25.044273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1049c5-0595-4e2e-89df-97fcca4069e4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:25.083205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25142877-188b-46c5-ab28-114ab26f1c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:25.084353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25142877-188b-46c5-ab28-114ab26f1c22 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:25.084968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25142877-188b-46c5-ab28-114ab26f1c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:25.085465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25142877-188b-46c5-ab28-114ab26f1c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:25.096306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:25.097795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25142877-188b-46c5-ab28-114ab26f1c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:25.100230 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25142877-188b-46c5-ab28-114ab26f1c22 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:25.101057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5c072-a013-4749-8bc5-d0911304e92a None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-25142877-188b-46c5-ab28-114ab26f1c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:25.116753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:25.117690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:25.118587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:25.118587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:25.118587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:25.118587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:25.120842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 300/599] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:25.121818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25142877-188b-46c5-ab28-114ab26f1c22 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:25.142463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fcf96-f31a-43b5-a76d-ce31b065789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:25.143103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fcf96-f31a-43b5-a76d-ce31b065789e None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:25.143503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fcf96-f31a-43b5-a76d-ce31b065789e None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:25.144417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fcf96-f31a-43b5-a76d-ce31b065789e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:25.152494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fcf96-f31a-43b5-a76d-ce31b065789e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:25.154136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fcf96-f31a-43b5-a76d-ce31b065789e None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-815fcf96-f31a-43b5-a76d-ce31b065789e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:25.167602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:25.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:25.169826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:25.169826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:25.169826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:25.169826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:25.169826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:25.169826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:25.169826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:25.169826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:25.176583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 300/600] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:25.177513 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fcf96-f31a-43b5-a76d-ce31b065789e None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:25.234674 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25142877-188b-46c5-ab28-114ab26f1c22 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:25.250201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:25.271601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb592031-0563-43e9-a60e-8b0af40682e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:25.272365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb592031-0563-43e9-a60e-8b0af40682e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:25.272729 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb592031-0563-43e9-a60e-8b0af40682e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:25.273107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb592031-0563-43e9-a60e-8b0af40682e5 None admin] PATH_INFO: `/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/f4ceb49020974e89b264c2a874dd82cf/roles/41a3de4f5213430bb14205f0f3aabadc` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:25.286903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fcf96-f31a-43b5-a76d-ce31b065789e None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:25.290130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb592031-0563-43e9-a60e-8b0af40682e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=48d9c81feed744bb9e322910711a0d3b, user_id=f4ceb49020974e89b264c2a874dd82cf, role_id=41a3de4f5213430bb14205f0f3aabadc)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:25.291672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb592031-0563-43e9-a60e-8b0af40682e5 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:25.322729 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0322e7-8b86-4132-846a-aea2ec5d73ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:25.323489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0322e7-8b86-4132-846a-aea2ec5d73ac None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:25.323821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0322e7-8b86-4132-846a-aea2ec5d73ac None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:25.324076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0322e7-8b86-4132-846a-aea2ec5d73ac None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:25.324761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0322e7-8b86-4132-846a-aea2ec5d73ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:25.325055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0322e7-8b86-4132-846a-aea2ec5d73ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:25.326402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0322e7-8b86-4132-846a-aea2ec5d73ac None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:25.343504 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 301/601] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:25.343504 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0322e7-8b86-4132-846a-aea2ec5d73ac None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:25.354054 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 301/602] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:25:25 2022] PUT /identity/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/f4ceb49020974e89b264c2a874dd82cf/roles/41a3de4f5213430bb14205f0f3aabadc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:25:25.355775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb592031-0563-43e9-a60e-8b0af40682e5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:25.368774 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:25.474958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0322e7-8b86-4132-846a-aea2ec5d73ac None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:25.505505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb592031-0563-43e9-a60e-8b0af40682e5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:25.525809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa518a-f335-4912-86d6-b50bee91b2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:25.526844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa518a-f335-4912-86d6-b50bee91b2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:25.527134 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa518a-f335-4912-86d6-b50bee91b2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:25.527410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa518a-f335-4912-86d6-b50bee91b2b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:25.528203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa518a-f335-4912-86d6-b50bee91b2b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:25.528512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa518a-f335-4912-86d6-b50bee91b2b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:25.530551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa518a-f335-4912-86d6-b50bee91b2b6 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:25.551619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f1d751-3568-4fec-a024-ca8d0a16d380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:25.552411 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1d751-3568-4fec-a024-ca8d0a16d380 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:25.553671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1d751-3568-4fec-a024-ca8d0a16d380 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:25.553671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f1d751-3568-4fec-a024-ca8d0a16d380 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:25.554792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 302/603] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:25.556314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c841fa3-9b3e-421e-9c5c-8fda5110ea1a None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:25.556602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c841fa3-9b3e-421e-9c5c-8fda5110ea1a None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:25.556875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c841fa3-9b3e-421e-9c5c-8fda5110ea1a None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:25.558971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 303/604] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:25.559868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c841fa3-9b3e-421e-9c5c-8fda5110ea1a None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:25.567146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1d751-3568-4fec-a024-ca8d0a16d380 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:25.568695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f1d751-3568-4fec-a024-ca8d0a16d380 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-62f1d751-3568-4fec-a024-ca8d0a16d380 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:25.586525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:25.587465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:25.588403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:25.588403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:25.588403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:25.588403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:25.588403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:25.588403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:25.588403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:25.588403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:25.588403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 302/605] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:25.590104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3183d78-e289-4215-97ef-706382b6b336 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:25.590395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3183d78-e289-4215-97ef-706382b6b336 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:25.590672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3183d78-e289-4215-97ef-706382b6b336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:25.614212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d3183d78-e289-4215-97ef-706382b6b336 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:25.615938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d3183d78-e289-4215-97ef-706382b6b336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:25.636476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:25.663464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:25.688582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c841fa3-9b3e-421e-9c5c-8fda5110ea1a None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:25.699792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 303/606] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:25.699792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3183d78-e289-4215-97ef-706382b6b336 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:25.734150 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae6f14-35a3-48da-90cb-ce54702de482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:25.734834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6f14-35a3-48da-90cb-ce54702de482 None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:25.735185 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6f14-35a3-48da-90cb-ce54702de482 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:25.735549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6f14-35a3-48da-90cb-ce54702de482 None admin] PATH_INFO: `/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/8ed104145f1f4a3aa76659ae6ceac4ef/roles/41a3de4f5213430bb14205f0f3aabadc` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:25.751476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae6f14-35a3-48da-90cb-ce54702de482 None admin] RBAC: Authorizing `identity:create_grant(project_id=48d9c81feed744bb9e322910711a0d3b, user_id=8ed104145f1f4a3aa76659ae6ceac4ef, role_id=41a3de4f5213430bb14205f0f3aabadc)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:25.753658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae6f14-35a3-48da-90cb-ce54702de482 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:25.806865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3183d78-e289-4215-97ef-706382b6b336 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:25.831428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 304/607] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:25:25 2022] PUT /identity/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/8ed104145f1f4a3aa76659ae6ceac4ef/roles/41a3de4f5213430bb14205f0f3aabadc => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:25:25.832932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d2a17-7358-42fd-8a23-124210866ce0 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:25.838911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d2a17-7358-42fd-8a23-124210866ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:25.838911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d2a17-7358-42fd-8a23-124210866ce0 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:25.838911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 305/608] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:25.838911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d2a17-7358-42fd-8a23-124210866ce0 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:25.861279 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d13fa-5017-4c74-a660-744c84bbb978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:25.862735 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d13fa-5017-4c74-a660-744c84bbb978 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:25.864104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d13fa-5017-4c74-a660-744c84bbb978 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:25.865234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d13fa-5017-4c74-a660-744c84bbb978 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:25.866165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d13fa-5017-4c74-a660-744c84bbb978 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:25.867051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d13fa-5017-4c74-a660-744c84bbb978 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:25.868533 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d13fa-5017-4c74-a660-744c84bbb978 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:25.883062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 304/609] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:25.884672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a24a4-8974-482c-b73b-035997f0f1c1 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:25.885067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a24a4-8974-482c-b73b-035997f0f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:25.885448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a24a4-8974-482c-b73b-035997f0f1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:25.906164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ea3a24a4-8974-482c-b73b-035997f0f1c1 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:25.907548 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ea3a24a4-8974-482c-b73b-035997f0f1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:25.920157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:25.991843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 305/610] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:25.991843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a24a4-8974-482c-b73b-035997f0f1c1 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:26.020022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d2a17-7358-42fd-8a23-124210866ce0 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:26.052062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:26.062523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04395a8b-36e2-4723-a3b6-1c387b90697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:26.063225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04395a8b-36e2-4723-a3b6-1c387b90697a None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:26.063813 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04395a8b-36e2-4723-a3b6-1c387b90697a None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:26.064100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04395a8b-36e2-4723-a3b6-1c387b90697a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:26.078809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04395a8b-36e2-4723-a3b6-1c387b90697a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-04395a8b-36e2-4723-a3b6-1c387b90697a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:26.085034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:26.086018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:26.086845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:26.086845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:26.086845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:26.086845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:26.086845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:26.086845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:26.086845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:26.086845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:26.086845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:26.086845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:26.086845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:26.086845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:26.087471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 306/611] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:26.088410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04395a8b-36e2-4723-a3b6-1c387b90697a None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:26.117797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a24a4-8974-482c-b73b-035997f0f1c1 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:26.161832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d661c2-ee9a-49e1-8e49-080c5f780f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:26.162542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d661c2-ee9a-49e1-8e49-080c5f780f16 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:26.162829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d661c2-ee9a-49e1-8e49-080c5f780f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:26.163107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d661c2-ee9a-49e1-8e49-080c5f780f16 None admin] PATH_INFO: `/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/b428f7d0d62049cf8fbbd05830d0d356/roles/41a3de4f5213430bb14205f0f3aabadc` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:26.179393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d661c2-ee9a-49e1-8e49-080c5f780f16 None admin] RBAC: Authorizing `identity:create_grant(project_id=48d9c81feed744bb9e322910711a0d3b, user_id=b428f7d0d62049cf8fbbd05830d0d356, role_id=41a3de4f5213430bb14205f0f3aabadc)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:26.180877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d661c2-ee9a-49e1-8e49-080c5f780f16 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:26.183109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:26.207066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04395a8b-36e2-4723-a3b6-1c387b90697a None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:26.243136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699323f-d44f-4673-8c2d-8fb9b550bc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:26.243698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699323f-d44f-4673-8c2d-8fb9b550bc46 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:26.244013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699323f-d44f-4673-8c2d-8fb9b550bc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:26.244287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699323f-d44f-4673-8c2d-8fb9b550bc46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:26.254806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699323f-d44f-4673-8c2d-8fb9b550bc46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-7699323f-d44f-4673-8c2d-8fb9b550bc46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:26.259705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:26.260661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:26.261483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:26.261483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:26.261483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:26.261483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:26.261483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:26.261483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:26.261483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:26.261483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:26.261483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:26.261483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:26.261483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:26.261483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:26.261483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 307/612] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:26.262195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699323f-d44f-4673-8c2d-8fb9b550bc46 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:26.269003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 306/613] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:25:25 2022] PUT /identity/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/b428f7d0d62049cf8fbbd05830d0d356/roles/41a3de4f5213430bb14205f0f3aabadc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:25:26.270112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d661c2-ee9a-49e1-8e49-080c5f780f16 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:26.323732 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:26.386347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699323f-d44f-4673-8c2d-8fb9b550bc46 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:26.450165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445bd9e-0b39-40ad-a36d-aefdac18b1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:26.450795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445bd9e-0b39-40ad-a36d-aefdac18b1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:26.451073 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445bd9e-0b39-40ad-a36d-aefdac18b1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:26.451346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445bd9e-0b39-40ad-a36d-aefdac18b1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:26.452106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445bd9e-0b39-40ad-a36d-aefdac18b1b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:26.452463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445bd9e-0b39-40ad-a36d-aefdac18b1b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:26.454398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445bd9e-0b39-40ad-a36d-aefdac18b1b9 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:26.466444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 308/614] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:26.472153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445bd9e-0b39-40ad-a36d-aefdac18b1b9 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:26.491002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d661c2-ee9a-49e1-8e49-080c5f780f16 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:26.548895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc65207-0655-4105-9b47-d2d7725724b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:26.549586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc65207-0655-4105-9b47-d2d7725724b0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:26.550404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc65207-0655-4105-9b47-d2d7725724b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:26.550682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc65207-0655-4105-9b47-d2d7725724b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:26.551509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc65207-0655-4105-9b47-d2d7725724b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:26.551848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc65207-0655-4105-9b47-d2d7725724b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:26.553237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc65207-0655-4105-9b47-d2d7725724b0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:26.563173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 307/615] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:26.568628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc65207-0655-4105-9b47-d2d7725724b0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:26.608445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445bd9e-0b39-40ad-a36d-aefdac18b1b9 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:26.620957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:26.648529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff347023-bdb9-4774-83ca-be590d848bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:26.649560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff347023-bdb9-4774-83ca-be590d848bda None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:26.649987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff347023-bdb9-4774-83ca-be590d848bda None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:26.650469 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff347023-bdb9-4774-83ca-be590d848bda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:26.663240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff347023-bdb9-4774-83ca-be590d848bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:26.664940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff347023-bdb9-4774-83ca-be590d848bda None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-ff347023-bdb9-4774-83ca-be590d848bda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:26.681489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:26.682601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:26.683658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:26.683658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:26.683658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:26.683658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:26.685591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 309/616] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:26.692156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff347023-bdb9-4774-83ca-be590d848bda None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:26.712856 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:26.805584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff347023-bdb9-4774-83ca-be590d848bda None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:26.849793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc65207-0655-4105-9b47-d2d7725724b0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:26.866349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732f052-2003-42a4-823b-cb60dc031982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:26.866977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732f052-2003-42a4-823b-cb60dc031982 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:26.867257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732f052-2003-42a4-823b-cb60dc031982 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:26.867531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732f052-2003-42a4-823b-cb60dc031982 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:26.868265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732f052-2003-42a4-823b-cb60dc031982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:26.868571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732f052-2003-42a4-823b-cb60dc031982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:26.869927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732f052-2003-42a4-823b-cb60dc031982 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:26.892339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 310/617] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:26.897751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732f052-2003-42a4-823b-cb60dc031982 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:26.902181 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f577a40-64a6-4162-90c0-5d39ba74c0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:26.902889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577a40-64a6-4162-90c0-5d39ba74c0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:26.903170 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577a40-64a6-4162-90c0-5d39ba74c0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:26.903485 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f577a40-64a6-4162-90c0-5d39ba74c0a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:26.916371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f577a40-64a6-4162-90c0-5d39ba74c0a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:26.918543 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f577a40-64a6-4162-90c0-5d39ba74c0a2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-0f577a40-64a6-4162-90c0-5d39ba74c0a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:26.937177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:26.938232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:26.939308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:26.939308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:26.939308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:26.939308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:26.939308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 308/618] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:26.948849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f577a40-64a6-4162-90c0-5d39ba74c0a2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:26.956762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:27.065953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f577a40-64a6-4162-90c0-5d39ba74c0a2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:27.076365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:27.104310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1fffd-8dfc-49c3-ab4e-fba63fe04a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:27.105367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1fffd-8dfc-49c3-ab4e-fba63fe04a48 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:27.105773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1fffd-8dfc-49c3-ab4e-fba63fe04a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:27.106151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1fffd-8dfc-49c3-ab4e-fba63fe04a48 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:27.106960 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1fffd-8dfc-49c3-ab4e-fba63fe04a48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:27.107369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1fffd-8dfc-49c3-ab4e-fba63fe04a48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:27.109358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1fffd-8dfc-49c3-ab4e-fba63fe04a48 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:27.125303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 309/619] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:27.132628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1fffd-8dfc-49c3-ab4e-fba63fe04a48 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:27.141633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732f052-2003-42a4-823b-cb60dc031982 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:27.211818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d5b3b-4d2d-40f8-9404-be46f59214c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:27.212484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d5b3b-4d2d-40f8-9404-be46f59214c9 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:27.212819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d5b3b-4d2d-40f8-9404-be46f59214c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:27.213139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d5b3b-4d2d-40f8-9404-be46f59214c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:27.224642 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d5b3b-4d2d-40f8-9404-be46f59214c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:27.226089 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d5b3b-4d2d-40f8-9404-be46f59214c9 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-8f5d5b3b-4d2d-40f8-9404-be46f59214c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:27.248580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:27.249579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:27.250534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:27.250534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:27.250534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:27.250534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:27.250534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:27.250534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:27.250534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:27.250534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:27.250534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:25:27.250534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:27.250534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 311/620] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 21:25:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:27.256645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d5b3b-4d2d-40f8-9404-be46f59214c9 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:27.333085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1fffd-8dfc-49c3-ab4e-fba63fe04a48 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:27.401850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ff385-d607-4bbb-b994-3b648c71a452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:27.402782 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff385-d607-4bbb-b994-3b648c71a452 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:27.403251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff385-d607-4bbb-b994-3b648c71a452 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:27.403682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ff385-d607-4bbb-b994-3b648c71a452 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:27.417355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ff385-d607-4bbb-b994-3b648c71a452 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:27.418806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ff385-d607-4bbb-b994-3b648c71a452 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:27.421955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-628ff385-d607-4bbb-b994-3b648c71a452 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:27.442176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:27.448037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:27.448972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:27.448972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:27.448972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:27.448972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:27.448972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:27.448972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:27.448972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:27.448972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:27.448972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 21:25:27.448972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:27.448972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 310/621] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:25:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:27.458028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ff385-d607-4bbb-b994-3b648c71a452 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:27.464021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d5b3b-4d2d-40f8-9404-be46f59214c9 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:27.520407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:27.538315 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467fc77-68fc-411a-b248-8ab72ff9357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:27.539001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467fc77-68fc-411a-b248-8ab72ff9357d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:27.539281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467fc77-68fc-411a-b248-8ab72ff9357d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:27.539549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467fc77-68fc-411a-b248-8ab72ff9357d None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:27.540442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467fc77-68fc-411a-b248-8ab72ff9357d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:27.540744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467fc77-68fc-411a-b248-8ab72ff9357d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:27.544646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467fc77-68fc-411a-b248-8ab72ff9357d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:27.581684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 312/622] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 21:25:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:27.591452 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467fc77-68fc-411a-b248-8ab72ff9357d None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:27.640322 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ff385-d607-4bbb-b994-3b648c71a452 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:27.685645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c245c-1320-4cf5-9e9f-aaeb4b181b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:27.686262 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c245c-1320-4cf5-9e9f-aaeb4b181b79 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:27.686541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c245c-1320-4cf5-9e9f-aaeb4b181b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:27.686811 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c245c-1320-4cf5-9e9f-aaeb4b181b79 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:27.687607 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c245c-1320-4cf5-9e9f-aaeb4b181b79 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:27.687937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c245c-1320-4cf5-9e9f-aaeb4b181b79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:27.692190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c245c-1320-4cf5-9e9f-aaeb4b181b79 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:27.722912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 311/623] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 25 21:25:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:27.722912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474dd8a-dde5-406e-8eef-6746b5b24ed8 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:27.722912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474dd8a-dde5-406e-8eef-6746b5b24ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:27.722912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474dd8a-dde5-406e-8eef-6746b5b24ed8 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:27.722912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 312/624] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:27.723962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474dd8a-dde5-406e-8eef-6746b5b24ed8 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:27.736620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467fc77-68fc-411a-b248-8ab72ff9357d None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:27.788763 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25585e-d21b-4958-bf4b-0cc796a58f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:27.790264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25585e-d21b-4958-bf4b-0cc796a58f58 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:27.790786 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25585e-d21b-4958-bf4b-0cc796a58f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:27.791270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25585e-d21b-4958-bf4b-0cc796a58f58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:27.807984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:27.834486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:27.854905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474dd8a-dde5-406e-8eef-6746b5b24ed8 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:27.886298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25585e-d21b-4958-bf4b-0cc796a58f58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:27.888053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25585e-d21b-4958-bf4b-0cc796a58f58 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:27.897237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d3623-5db3-400c-9d19-4e995c703d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:27.898328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d3623-5db3-400c-9d19-4e995c703d80 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:27.898816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d3623-5db3-400c-9d19-4e995c703d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:27.899289 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d3623-5db3-400c-9d19-4e995c703d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:27.912379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d3623-5db3-400c-9d19-4e995c703d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:27.914297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d3623-5db3-400c-9d19-4e995c703d80 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-bb7d3623-5db3-400c-9d19-4e995c703d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:27.935152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:27.936149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:27.937067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:27.937067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:27.937067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:27.937067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:27.939510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 313/625] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:27.941723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429f4fa-003f-4937-8df6-9dfd49acc286 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:27.942244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429f4fa-003f-4937-8df6-9dfd49acc286 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:27.942724 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429f4fa-003f-4937-8df6-9dfd49acc286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:27.962861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-2429f4fa-003f-4937-8df6-9dfd49acc286 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:27.964622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-2429f4fa-003f-4937-8df6-9dfd49acc286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:28.019514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 313/626] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:25:28.020408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25585e-d21b-4958-bf4b-0cc796a58f58 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:28.045860 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 314/627] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:28.047182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429f4fa-003f-4937-8df6-9dfd49acc286 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:28.087132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:28.126149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:28.148822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25585e-d21b-4958-bf4b-0cc796a58f58 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:28.162604 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429f4fa-003f-4937-8df6-9dfd49acc286 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:28.188873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3358824-92c0-4440-9b2f-fcbe6fcda5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:28.189836 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3358824-92c0-4440-9b2f-fcbe6fcda5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:28.190360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3358824-92c0-4440-9b2f-fcbe6fcda5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:28.191026 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3358824-92c0-4440-9b2f-fcbe6fcda5c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:28.191988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3358824-92c0-4440-9b2f-fcbe6fcda5c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:28.192516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3358824-92c0-4440-9b2f-fcbe6fcda5c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:28.194081 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3358824-92c0-4440-9b2f-fcbe6fcda5c7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:28.199172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd7942-2029-4275-b84a-4f087d92681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:28.199846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd7942-2029-4275-b84a-4f087d92681e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:28.200131 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd7942-2029-4275-b84a-4f087d92681e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:28.200405 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd7942-2029-4275-b84a-4f087d92681e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:28.207958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 314/628] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:28.209068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3358824-92c0-4440-9b2f-fcbe6fcda5c7 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:28.215550 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd7942-2029-4275-b84a-4f087d92681e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:28.217037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd7942-2029-4275-b84a-4f087d92681e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-30cd7942-2029-4275-b84a-4f087d92681e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:28.232995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:28.234017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:28.234918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:28.234918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:28.234918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:28.234918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:28.234918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 315/629] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:28.235493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971c7b4-e206-4e26-ae94-3721cbc0cd5e None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:28.235678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971c7b4-e206-4e26-ae94-3721cbc0cd5e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:28.235986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971c7b4-e206-4e26-ae94-3721cbc0cd5e None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:28.239849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 316/630] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:28.239849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971c7b4-e206-4e26-ae94-3721cbc0cd5e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:28.324810 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:28.328530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3358824-92c0-4440-9b2f-fcbe6fcda5c7 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:28.347065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971c7b4-e206-4e26-ae94-3721cbc0cd5e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:28.371373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:28.392478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aaa71-3b82-405f-92e2-8d3a728b21f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:28.392478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aaa71-3b82-405f-92e2-8d3a728b21f5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:28.392478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aaa71-3b82-405f-92e2-8d3a728b21f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:28.392478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aaa71-3b82-405f-92e2-8d3a728b21f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:28.397173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5aaa71-3b82-405f-92e2-8d3a728b21f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:28.398862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5aaa71-3b82-405f-92e2-8d3a728b21f5 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-7e5aaa71-3b82-405f-92e2-8d3a728b21f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:28.412699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:28.413733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:28.414640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:28.414640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:28.414640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:28.414640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:28.414640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:28.414640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:28.414640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:28.414640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:28.414640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 317/631] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:28.415152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aaa71-3b82-405f-92e2-8d3a728b21f5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:28.486322 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1320b-839d-41be-b2be-9e072672c400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:28.487789 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1320b-839d-41be-b2be-9e072672c400 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:28.488381 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1320b-839d-41be-b2be-9e072672c400 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:28.488827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1320b-839d-41be-b2be-9e072672c400 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:28.499397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1320b-839d-41be-b2be-9e072672c400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-dfc1320b-839d-41be-b2be-9e072672c400 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:28.505429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:28.506393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:28.507242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:28.507242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:28.507242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:28.507242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:28.507242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:28.507242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:28.507242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:28.507242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:28.507242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:28.507242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:28.507242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:28.507242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:28.507242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 315/632] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:28.508818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d7fad-7230-4010-8a1b-fc3088613d82 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:28.508818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d7fad-7230-4010-8a1b-fc3088613d82 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:28.508818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d7fad-7230-4010-8a1b-fc3088613d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:28.528161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-4b0d7fad-7230-4010-8a1b-fc3088613d82 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:28.529365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-4b0d7fad-7230-4010-8a1b-fc3088613d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:28.533525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aaa71-3b82-405f-92e2-8d3a728b21f5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:28.570555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e189b2c-ffb3-4741-8bf0-c8275acea8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:28.571176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e189b2c-ffb3-4741-8bf0-c8275acea8da None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:28.571460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e189b2c-ffb3-4741-8bf0-c8275acea8da None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:28.571752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e189b2c-ffb3-4741-8bf0-c8275acea8da None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:28.572465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e189b2c-ffb3-4741-8bf0-c8275acea8da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:28.572772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e189b2c-ffb3-4741-8bf0-c8275acea8da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:28.574148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e189b2c-ffb3-4741-8bf0-c8275acea8da None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:28.587217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 318/633] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:28.588647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e189b2c-ffb3-4741-8bf0-c8275acea8da None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:28.603564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 316/634] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:28.609120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d7fad-7230-4010-8a1b-fc3088613d82 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:28.637674 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:28.708378 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e189b2c-ffb3-4741-8bf0-c8275acea8da None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:28.712000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:28.721537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d7fad-7230-4010-8a1b-fc3088613d82 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:28.747204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe74820-c0b5-4fea-a1a0-1dfbde243c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:28.747854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe74820-c0b5-4fea-a1a0-1dfbde243c4f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:28.748140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe74820-c0b5-4fea-a1a0-1dfbde243c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:28.748414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe74820-c0b5-4fea-a1a0-1dfbde243c4f None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:28.749161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe74820-c0b5-4fea-a1a0-1dfbde243c4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:28.749469 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe74820-c0b5-4fea-a1a0-1dfbde243c4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:28.750892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe74820-c0b5-4fea-a1a0-1dfbde243c4f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:28.756334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4535aa7-fc9d-4a8b-94b2-42ad6d3a25cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:28.756953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535aa7-fc9d-4a8b-94b2-42ad6d3a25cb None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:28.757235 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535aa7-fc9d-4a8b-94b2-42ad6d3a25cb None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:28.757508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4535aa7-fc9d-4a8b-94b2-42ad6d3a25cb None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:28.758225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4535aa7-fc9d-4a8b-94b2-42ad6d3a25cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:28.758528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4535aa7-fc9d-4a8b-94b2-42ad6d3a25cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:28.759908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4535aa7-fc9d-4a8b-94b2-42ad6d3a25cb None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:28.763258 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 319/635] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:28.764080 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe74820-c0b5-4fea-a1a0-1dfbde243c4f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:28.772304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 317/636] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:28.773117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4535aa7-fc9d-4a8b-94b2-42ad6d3a25cb None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:28.867385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:28.870466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe74820-c0b5-4fea-a1a0-1dfbde243c4f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:28.871974 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4535aa7-fc9d-4a8b-94b2-42ad6d3a25cb None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:28.903599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033ead7-dc18-4976-837a-c675976bb81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:28.904262 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033ead7-dc18-4976-837a-c675976bb81f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:28.904547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033ead7-dc18-4976-837a-c675976bb81f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:28.904821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033ead7-dc18-4976-837a-c675976bb81f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:28.905878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42547ea-0a40-46f2-9693-40c930d413ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:28.906516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42547ea-0a40-46f2-9693-40c930d413ce None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:28.906797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42547ea-0a40-46f2-9693-40c930d413ce None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:28.907068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42547ea-0a40-46f2-9693-40c930d413ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:28.912285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033ead7-dc18-4976-837a-c675976bb81f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:28.913724 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033ead7-dc18-4976-837a-c675976bb81f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:28.917843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42547ea-0a40-46f2-9693-40c930d413ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-e42547ea-0a40-46f2-9693-40c930d413ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:28.922736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:28.923825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:28.925419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:28.925419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:28.925419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:28.925419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:28.925419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:28.925419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:28.925419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:28.925419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:28.925419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:28.925419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:28.925419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:28.925419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:28.925419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 318/637] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-6033ead7-dc18-4976-837a-c675976bb81f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:28.926144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:28.927012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:28.928461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:28.928461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:28.928461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:28.928461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:28.928461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:28.928461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:28.928461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:28.928461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:28.928461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 320/638] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:28.929153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06e5f-9ca9-45a7-b65b-f74da78c9e12 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:28.929248 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033ead7-dc18-4976-837a-c675976bb81f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:28.929340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06e5f-9ca9-45a7-b65b-f74da78c9e12 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:28.929340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06e5f-9ca9-45a7-b65b-f74da78c9e12 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:28.929735 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 319/639] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:28.930428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06e5f-9ca9-45a7-b65b-f74da78c9e12 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:28.947141 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:29.034162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06e5f-9ca9-45a7-b65b-f74da78c9e12 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:29.035262 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033ead7-dc18-4976-837a-c675976bb81f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:29.068761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76363e-3e4f-44a0-a6ff-96570ed70050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:29.069397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76363e-3e4f-44a0-a6ff-96570ed70050 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:29.069679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76363e-3e4f-44a0-a6ff-96570ed70050 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:29.069953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76363e-3e4f-44a0-a6ff-96570ed70050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:29.071999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321fc5a-4b2b-4389-88fc-70fa331be1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:29.072664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321fc5a-4b2b-4389-88fc-70fa331be1e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:29.072950 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321fc5a-4b2b-4389-88fc-70fa331be1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:29.073227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321fc5a-4b2b-4389-88fc-70fa331be1e0 None admin] PATH_INFO: `/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/4c4863a61a484ed4b0dac01e908cd05a/roles/41a3de4f5213430bb14205f0f3aabadc` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:29.079731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76363e-3e4f-44a0-a6ff-96570ed70050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:29.081859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76363e-3e4f-44a0-a6ff-96570ed70050 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:29.088281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321fc5a-4b2b-4389-88fc-70fa331be1e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=48d9c81feed744bb9e322910711a0d3b, user_id=4c4863a61a484ed4b0dac01e908cd05a, role_id=41a3de4f5213430bb14205f0f3aabadc)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:29.089702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321fc5a-4b2b-4389-88fc-70fa331be1e0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-fe76363e-3e4f-44a0-a6ff-96570ed70050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:29.097015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:29.098239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:29.099560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:29.099560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:29.099560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:29.099560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:29.099560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 320/640] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:29.099560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76363e-3e4f-44a0-a6ff-96570ed70050 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:29.158432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:29.173421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 321/641] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:25:28 2022] PUT /identity/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/4c4863a61a484ed4b0dac01e908cd05a/roles/41a3de4f5213430bb14205f0f3aabadc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:25:29.174288 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321fc5a-4b2b-4389-88fc-70fa331be1e0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:29.199711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76363e-3e4f-44a0-a6ff-96570ed70050 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:29.200772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:29.241285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b9f5a-3922-4ce4-bb35-0eaf52b12b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:29.242029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b9f5a-3922-4ce4-bb35-0eaf52b12b7b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:29.242385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b9f5a-3922-4ce4-bb35-0eaf52b12b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:29.242664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b9f5a-3922-4ce4-bb35-0eaf52b12b7b None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:29.243570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b9f5a-3922-4ce4-bb35-0eaf52b12b7b None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:29.243809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b9f5a-3922-4ce4-bb35-0eaf52b12b7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:29.245140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b9f5a-3922-4ce4-bb35-0eaf52b12b7b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:29.254802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 321/642] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:29.256209 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e2841-0cf2-4992-b4b8-bf192a0f88e5 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:29.256500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e2841-0cf2-4992-b4b8-bf192a0f88e5 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:29.256774 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e2841-0cf2-4992-b4b8-bf192a0f88e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:29.278731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-ab6e2841-0cf2-4992-b4b8-bf192a0f88e5 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:29.280375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-ab6e2841-0cf2-4992-b4b8-bf192a0f88e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:29.312629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321fc5a-4b2b-4389-88fc-70fa331be1e0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:29.356220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cb3a5-827b-481f-bb4d-76c68ab5fb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:29.357225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cb3a5-827b-481f-bb4d-76c68ab5fb0d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:29.357715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cb3a5-827b-481f-bb4d-76c68ab5fb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:29.358230 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cb3a5-827b-481f-bb4d-76c68ab5fb0d None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:29.359061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 322/643] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:29.359434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cb3a5-827b-481f-bb4d-76c68ab5fb0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:29.359924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e2841-0cf2-4992-b4b8-bf192a0f88e5 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:29.360189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cb3a5-827b-481f-bb4d-76c68ab5fb0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:29.361882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cb3a5-827b-481f-bb4d-76c68ab5fb0d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:29.375630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 322/644] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:29.376843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cb3a5-827b-481f-bb4d-76c68ab5fb0d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:29.428063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:29.453977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:29.472450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e2841-0cf2-4992-b4b8-bf192a0f88e5 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:29.493042 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cb3a5-827b-481f-bb4d-76c68ab5fb0d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:29.509058 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fef66a-85f5-45a9-927b-589aff009d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:29.509674 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fef66a-85f5-45a9-927b-589aff009d3b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:29.509959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fef66a-85f5-45a9-927b-589aff009d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:29.510234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fef66a-85f5-45a9-927b-589aff009d3b None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:29.510961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fef66a-85f5-45a9-927b-589aff009d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:29.511273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fef66a-85f5-45a9-927b-589aff009d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:29.512659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fef66a-85f5-45a9-927b-589aff009d3b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:29.530137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 323/645] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:29.530137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fef66a-85f5-45a9-927b-589aff009d3b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:29.537315 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb93e1-214b-47cf-a1b2-706f75970535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:29.537967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb93e1-214b-47cf-a1b2-706f75970535 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:29.538253 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb93e1-214b-47cf-a1b2-706f75970535 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:29.538530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb93e1-214b-47cf-a1b2-706f75970535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:29.550469 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb93e1-214b-47cf-a1b2-706f75970535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:29.551960 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb93e1-214b-47cf-a1b2-706f75970535 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-23cb93e1-214b-47cf-a1b2-706f75970535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:29.567264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:29.568206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:29.569566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:29.569566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:29.569566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:29.569566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:29.569566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 323/646] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:29.573680 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb93e1-214b-47cf-a1b2-706f75970535 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:29.642508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fef66a-85f5-45a9-927b-589aff009d3b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:29.660257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:29.681125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb93e1-214b-47cf-a1b2-706f75970535 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:29.684454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c7628-901b-4c97-87ee-b09142f2230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:29.685078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c7628-901b-4c97-87ee-b09142f2230e None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:29.685362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c7628-901b-4c97-87ee-b09142f2230e None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:29.685640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c7628-901b-4c97-87ee-b09142f2230e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:29.686491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c7628-901b-4c97-87ee-b09142f2230e None admin] RBAC: Adding query filter params (role.id=41a3de4f5213430bb14205f0f3aabadc, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=7d3d6613476c445b82302df5025f3ce6) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:29.686851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c7628-901b-4c97-87ee-b09142f2230e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:29.688313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c7628-901b-4c97-87ee-b09142f2230e None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:29.699102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 324/647] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:29 2022] GET /identity/v3/role_assignments?user.id=7d3d6613476c445b82302df5025f3ce6&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=41a3de4f5213430bb14205f0f3aabadc => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:29.708903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c7628-901b-4c97-87ee-b09142f2230e None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:29.711369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:29.734898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1896dc-9ed3-4694-84b9-9fe660d323cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:29.735916 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1896dc-9ed3-4694-84b9-9fe660d323cc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:29.736530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1896dc-9ed3-4694-84b9-9fe660d323cc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:29.737475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1896dc-9ed3-4694-84b9-9fe660d323cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:29.753781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1896dc-9ed3-4694-84b9-9fe660d323cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-7d1896dc-9ed3-4694-84b9-9fe660d323cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:29.759826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:29.761039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:29.761888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:29.761888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:29.761888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:29.761888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:29.761888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:29.761888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:29.761888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:29.761888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:29.761888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:29.761888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:29.761888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:29.761888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:29.762518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 324/648] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:29.763635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1896dc-9ed3-4694-84b9-9fe660d323cc None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:29.836060 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c7628-901b-4c97-87ee-b09142f2230e None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:29.874194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb2679-b2ec-4433-8594-cc79622757f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:29.875647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb2679-b2ec-4433-8594-cc79622757f7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:29.876159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb2679-b2ec-4433-8594-cc79622757f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:29.876645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb2679-b2ec-4433-8594-cc79622757f7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:29.884218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1896dc-9ed3-4694-84b9-9fe660d323cc None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:29.886190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb2679-b2ec-4433-8594-cc79622757f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:29.887888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb2679-b2ec-4433-8594-cc79622757f7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-acfb2679-b2ec-4433-8594-cc79622757f7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:29.901438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:29.902652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:29.903592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:29.903592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:29.903592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:29.903592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:29.903592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:29.903592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:29.903592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:29.903592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:29.903592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 21:25:29.903592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:29.904177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 325/649] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:29.909514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb2679-b2ec-4433-8594-cc79622757f7 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:29.931944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5ee9b-f438-45f0-a7f6-101c2c492465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:29.932580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5ee9b-f438-45f0-a7f6-101c2c492465 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:29.932864 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5ee9b-f438-45f0-a7f6-101c2c492465 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:29.933140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5ee9b-f438-45f0-a7f6-101c2c492465 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:29.934433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5ee9b-f438-45f0-a7f6-101c2c492465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:29.934749 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5ee9b-f438-45f0-a7f6-101c2c492465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:29.936198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5ee9b-f438-45f0-a7f6-101c2c492465 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:29.949817 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 325/650] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:29.950490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5ee9b-f438-45f0-a7f6-101c2c492465 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:29.958869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:30.007571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:30.043839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb2679-b2ec-4433-8594-cc79622757f7 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:30.074775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5ee9b-f438-45f0-a7f6-101c2c492465 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:30.091328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5961116-c932-478b-bca9-4c0d0433f1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:30.092007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961116-c932-478b-bca9-4c0d0433f1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:30.092413 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961116-c932-478b-bca9-4c0d0433f1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:30.092696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961116-c932-478b-bca9-4c0d0433f1f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:30.093676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5961116-c932-478b-bca9-4c0d0433f1f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:30.093991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5961116-c932-478b-bca9-4c0d0433f1f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:30.095776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5961116-c932-478b-bca9-4c0d0433f1f1 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:30.108819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 326/651] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:30.109739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5961116-c932-478b-bca9-4c0d0433f1f1 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:30.120474 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f32bc-c31f-48b2-8151-01a9dbeb924c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:30.121113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f32bc-c31f-48b2-8151-01a9dbeb924c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:30.121398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f32bc-c31f-48b2-8151-01a9dbeb924c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:30.121671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f32bc-c31f-48b2-8151-01a9dbeb924c None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:30.123018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f32bc-c31f-48b2-8151-01a9dbeb924c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:30.123327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f32bc-c31f-48b2-8151-01a9dbeb924c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:30.125341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f32bc-c31f-48b2-8151-01a9dbeb924c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:30.151195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 326/652] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 25 21:25:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:30.152106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f32bc-c31f-48b2-8151-01a9dbeb924c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:30.232206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5961116-c932-478b-bca9-4c0d0433f1f1 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:30.233962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:30.271961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438a92c-261a-4007-abb2-14c7d99d725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:30.272535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438a92c-261a-4007-abb2-14c7d99d725b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:30.273065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438a92c-261a-4007-abb2-14c7d99d725b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:30.273346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438a92c-261a-4007-abb2-14c7d99d725b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:30.278364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:30.281534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f32bc-c31f-48b2-8151-01a9dbeb924c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:30.283540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438a92c-261a-4007-abb2-14c7d99d725b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:30.286876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438a92c-261a-4007-abb2-14c7d99d725b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-9438a92c-261a-4007-abb2-14c7d99d725b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:30.302431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:30.304319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:30.305594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:30.305594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:30.305594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:30.305594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:30.305594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:30.305594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:30.305594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:30.305594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:30.305594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:25:30.305594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:30.310898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 327/653] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:30.310898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438a92c-261a-4007-abb2-14c7d99d725b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:30.330165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7f9f5-4348-4735-941c-5c63bb76e268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:30.331588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7f9f5-4348-4735-941c-5c63bb76e268 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:30.331919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7f9f5-4348-4735-941c-5c63bb76e268 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:30.332196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7f9f5-4348-4735-941c-5c63bb76e268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:30.342912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7f9f5-4348-4735-941c-5c63bb76e268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:30.344413 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7f9f5-4348-4735-941c-5c63bb76e268 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b0d7f9f5-4348-4735-941c-5c63bb76e268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:30.359715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:30.361821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:30.363919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:30.363919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:30.363919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:30.363919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:30.363919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 327/654] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:30.363919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7f9f5-4348-4735-941c-5c63bb76e268 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:30.437396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438a92c-261a-4007-abb2-14c7d99d725b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:30.479576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5a034-1b52-4be0-8d24-ea138a22ebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:30.480510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a034-1b52-4be0-8d24-ea138a22ebce None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:30.480791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a034-1b52-4be0-8d24-ea138a22ebce None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:30.481067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a034-1b52-4be0-8d24-ea138a22ebce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:30.499340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7f9f5-4348-4735-941c-5c63bb76e268 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:30.524440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:30.542092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17ea6b-000f-4c4c-a81f-7a6d10277e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:30.543496 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17ea6b-000f-4c4c-a81f-7a6d10277e74 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:30.544333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17ea6b-000f-4c4c-a81f-7a6d10277e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:30.545064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17ea6b-000f-4c4c-a81f-7a6d10277e74 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:30.546067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17ea6b-000f-4c4c-a81f-7a6d10277e74 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:30.546704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17ea6b-000f-4c4c-a81f-7a6d10277e74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:30.548667 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17ea6b-000f-4c4c-a81f-7a6d10277e74 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:30.567607 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5a034-1b52-4be0-8d24-ea138a22ebce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:30.570478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5a034-1b52-4be0-8d24-ea138a22ebce None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:30.575702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 328/655] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 25 21:25:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:30.576734 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17ea6b-000f-4c4c-a81f-7a6d10277e74 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:30.591598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:30.686491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 328/656] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:25:30.687569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5a034-1b52-4be0-8d24-ea138a22ebce None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:30.719091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17ea6b-000f-4c4c-a81f-7a6d10277e74 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:30.756335 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:30.762026 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338b1fd-e7a6-4558-87a0-8f9973dc0d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:30.762736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b1fd-e7a6-4558-87a0-8f9973dc0d47 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:30.762919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b1fd-e7a6-4558-87a0-8f9973dc0d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:30.763194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b1fd-e7a6-4558-87a0-8f9973dc0d47 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:30.764031 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338b1fd-e7a6-4558-87a0-8f9973dc0d47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:30.774942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338b1fd-e7a6-4558-87a0-8f9973dc0d47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:30.774942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338b1fd-e7a6-4558-87a0-8f9973dc0d47 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:30.781859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 329/657] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:30.781859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338b1fd-e7a6-4558-87a0-8f9973dc0d47 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:30.816978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5a034-1b52-4be0-8d24-ea138a22ebce None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:30.857510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:30.864377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8362a-f431-48da-bfc4-7cc733385545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:30.865212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8362a-f431-48da-bfc4-7cc733385545 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:30.865645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8362a-f431-48da-bfc4-7cc733385545 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:30.866069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8362a-f431-48da-bfc4-7cc733385545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:30.892682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338b1fd-e7a6-4558-87a0-8f9973dc0d47 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:30.939403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3d366-5840-4583-8bb2-162ffac64f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:30.940612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3d366-5840-4583-8bb2-162ffac64f73 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:30.940998 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3d366-5840-4583-8bb2-162ffac64f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:30.941284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3d366-5840-4583-8bb2-162ffac64f73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:30.952810 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3d366-5840-4583-8bb2-162ffac64f73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:30.952962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8362a-f431-48da-bfc4-7cc733385545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:30.954336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3d366-5840-4583-8bb2-162ffac64f73 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:30.955010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8362a-f431-48da-bfc4-7cc733385545 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-99a3d366-5840-4583-8bb2-162ffac64f73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:30.969077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:30.970010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:30.970873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:30.970873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:30.970873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:30.970873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:30.970873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 330/658] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:30.972220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3d366-5840-4583-8bb2-162ffac64f73 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:31.029299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:31.078963 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 329/659] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:25:31.080435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8362a-f431-48da-bfc4-7cc733385545 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:31.098290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3d366-5840-4583-8bb2-162ffac64f73 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:31.123967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:31.137009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdd1b1-548b-4524-8813-83dd51292bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:31.137773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdd1b1-548b-4524-8813-83dd51292bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:31.138205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdd1b1-548b-4524-8813-83dd51292bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:31.138448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdd1b1-548b-4524-8813-83dd51292bf8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:31.147227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdd1b1-548b-4524-8813-83dd51292bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:31.149062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdd1b1-548b-4524-8813-83dd51292bf8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-1dcdd1b1-548b-4524-8813-83dd51292bf8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:31.163447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:31.164635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:31.165765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:31.165765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:31.165765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:31.165765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:31.165765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:31.165765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:31.165765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:31.165765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:31.165765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 21:25:31.165765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:31.173035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 331/660] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:31.174048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdd1b1-548b-4524-8813-83dd51292bf8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:31.216179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8362a-f431-48da-bfc4-7cc733385545 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:31.258809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622a763-eb19-40ba-aafc-c989aa5a563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:31.259453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a763-eb19-40ba-aafc-c989aa5a563f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:31.259985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a763-eb19-40ba-aafc-c989aa5a563f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:31.259985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a763-eb19-40ba-aafc-c989aa5a563f None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:31.260722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622a763-eb19-40ba-aafc-c989aa5a563f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:31.261174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622a763-eb19-40ba-aafc-c989aa5a563f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:31.262514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622a763-eb19-40ba-aafc-c989aa5a563f None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:31.279011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 330/661] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:31.279011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622a763-eb19-40ba-aafc-c989aa5a563f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:31.289696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdd1b1-548b-4524-8813-83dd51292bf8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:31.306092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:31.325843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a5319-e5e8-4aed-8355-5b5c59dd8336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:31.326534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a5319-e5e8-4aed-8355-5b5c59dd8336 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:31.326818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a5319-e5e8-4aed-8355-5b5c59dd8336 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:31.327098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a5319-e5e8-4aed-8355-5b5c59dd8336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:31.339483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a5319-e5e8-4aed-8355-5b5c59dd8336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:31.341016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a5319-e5e8-4aed-8355-5b5c59dd8336 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-e48a5319-e5e8-4aed-8355-5b5c59dd8336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:31.355544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:31.356578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:31.357468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:31.357468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:31.357468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:31.357468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:31.357468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 332/662] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:31.358023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5e8ee-5700-4ad2-bc56-334daef6e53c None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:31.358155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5e8ee-5700-4ad2-bc56-334daef6e53c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:31.358436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5e8ee-5700-4ad2-bc56-334daef6e53c None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:31.364365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 333/663] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:31.365135 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5e8ee-5700-4ad2-bc56-334daef6e53c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:31.391132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622a763-eb19-40ba-aafc-c989aa5a563f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:31.401392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:31.428990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45863f-1922-451d-979c-573844a4cda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:31.429681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45863f-1922-451d-979c-573844a4cda5 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:31.429967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45863f-1922-451d-979c-573844a4cda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:31.430244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45863f-1922-451d-979c-573844a4cda5 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:31.431040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45863f-1922-451d-979c-573844a4cda5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:31.431351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45863f-1922-451d-979c-573844a4cda5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:31.432816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45863f-1922-451d-979c-573844a4cda5 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:31.455222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 331/664] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Jul 25 21:25:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:31.455222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45863f-1922-451d-979c-573844a4cda5 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:31.483904 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5e8ee-5700-4ad2-bc56-334daef6e53c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:31.521969 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3afe14-4218-43e1-b1a1-19099941f1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:31.522879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3afe14-4218-43e1-b1a1-19099941f1cb None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:31.523304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3afe14-4218-43e1-b1a1-19099941f1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:31.523724 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3afe14-4218-43e1-b1a1-19099941f1cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:31.530930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3afe14-4218-43e1-b1a1-19099941f1cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:31.532664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3afe14-4218-43e1-b1a1-19099941f1cb None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:31.542760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-db3afe14-4218-43e1-b1a1-19099941f1cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:31.545585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:31.546899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:31.547971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:31.547971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:31.547971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:31.547971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:31.547971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:31.547971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:31.547971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:31.547971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:31.554787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 334/665] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:31.556104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42d047-6f97-40ee-9dbc-77f2f529960a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:31.556526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42d047-6f97-40ee-9dbc-77f2f529960a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:31.556813 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42d047-6f97-40ee-9dbc-77f2f529960a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:31.563117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45863f-1922-451d-979c-573844a4cda5 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:31.577640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-7b42d047-6f97-40ee-9dbc-77f2f529960a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:31.579615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7b42d047-6f97-40ee-9dbc-77f2f529960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:31.601572 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ecfe9-e4ae-461a-8b6f-938fad0730c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:31.602170 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ecfe9-e4ae-461a-8b6f-938fad0730c5 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:31.602456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ecfe9-e4ae-461a-8b6f-938fad0730c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:31.602732 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ecfe9-e4ae-461a-8b6f-938fad0730c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:31.603440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ecfe9-e4ae-461a-8b6f-938fad0730c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:31.603823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ecfe9-e4ae-461a-8b6f-938fad0730c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:31.605135 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ecfe9-e4ae-461a-8b6f-938fad0730c5 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:31.621516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 332/666] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:31.621516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ecfe9-e4ae-461a-8b6f-938fad0730c5 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:31.656661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 335/667] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:31.660749 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42d047-6f97-40ee-9dbc-77f2f529960a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:31.704744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:31.728927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ecfe9-e4ae-461a-8b6f-938fad0730c5 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:31.763280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbb9cb-bd6c-4d5b-ac55-10bc1932cbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:31.763942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb9cb-bd6c-4d5b-ac55-10bc1932cbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:31.764226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb9cb-bd6c-4d5b-ac55-10bc1932cbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:31.764501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb9cb-bd6c-4d5b-ac55-10bc1932cbd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:31.776331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:31.792464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42d047-6f97-40ee-9dbc-77f2f529960a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:31.828529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be3c28-a797-40d5-8879-3c8ef5ef106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:31.829074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3c28-a797-40d5-8879-3c8ef5ef106e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:31.829359 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3c28-a797-40d5-8879-3c8ef5ef106e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:31.829634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3c28-a797-40d5-8879-3c8ef5ef106e None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:31.830391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be3c28-a797-40d5-8879-3c8ef5ef106e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:31.830872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be3c28-a797-40d5-8879-3c8ef5ef106e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:31.832344 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be3c28-a797-40d5-8879-3c8ef5ef106e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:31.841975 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbb9cb-bd6c-4d5b-ac55-10bc1932cbd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:31.843552 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbb9cb-bd6c-4d5b-ac55-10bc1932cbd5 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:31.849853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 336/668] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:31.849853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be3c28-a797-40d5-8879-3c8ef5ef106e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:31.938863 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:31.954202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be3c28-a797-40d5-8879-3c8ef5ef106e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:31.959983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 333/669] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:25:31.959983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbb9cb-bd6c-4d5b-ac55-10bc1932cbd5 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:31.991160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecd2ff-1058-470c-b199-4220d6509f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:31.991848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecd2ff-1058-470c-b199-4220d6509f3b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:31.992132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecd2ff-1058-470c-b199-4220d6509f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:31.992405 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecd2ff-1058-470c-b199-4220d6509f3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:31.998957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecd2ff-1058-470c-b199-4220d6509f3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:32.000437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecd2ff-1058-470c-b199-4220d6509f3b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:32.000644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-8cecd2ff-1058-470c-b199-4220d6509f3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:32.013127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:32.014036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:32.015109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:32.015109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:32.015109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:32.015109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:32.015109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:32.015109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:32.015109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:32.015109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:32.015109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 337/670] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:32.015109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecd2ff-1058-470c-b199-4220d6509f3b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:32.061250 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbb9cb-bd6c-4d5b-ac55-10bc1932cbd5 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:32.095466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838614f9-1dce-450b-b9a0-97a7583a2e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:32.096062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838614f9-1dce-450b-b9a0-97a7583a2e72 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:32.096883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838614f9-1dce-450b-b9a0-97a7583a2e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:32.097161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838614f9-1dce-450b-b9a0-97a7583a2e72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:32.107007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838614f9-1dce-450b-b9a0-97a7583a2e72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-838614f9-1dce-450b-b9a0-97a7583a2e72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:32.112070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:32.113255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:32.114348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:32.114348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:32.114348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:32.114348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:32.114348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:32.114348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:32.114348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:32.114348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:32.114348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:32.114348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:32.114348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:32.114348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:32.114348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 334/671] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:32.114348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366c80e-41ec-4945-bc86-ec2b2f260f07 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:32.115256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366c80e-41ec-4945-bc86-ec2b2f260f07 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:32.115256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366c80e-41ec-4945-bc86-ec2b2f260f07 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:32.116132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 335/672] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:32.116823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366c80e-41ec-4945-bc86-ec2b2f260f07 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:32.122293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecd2ff-1058-470c-b199-4220d6509f3b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:32.158133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c803b91-48ec-4835-b31c-41df18eb21ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:32.159373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c803b91-48ec-4835-b31c-41df18eb21ab None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:32.159620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c803b91-48ec-4835-b31c-41df18eb21ab None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:32.159938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c803b91-48ec-4835-b31c-41df18eb21ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:32.160730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c803b91-48ec-4835-b31c-41df18eb21ab None admin] RBAC: Adding query filter params (role.id=41a3de4f5213430bb14205f0f3aabadc, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=f4ceb49020974e89b264c2a874dd82cf) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:32.161045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c803b91-48ec-4835-b31c-41df18eb21ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:32.162735 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c803b91-48ec-4835-b31c-41df18eb21ab None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:32.168621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 338/673] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:32 2022] GET /identity/v3/role_assignments?user.id=f4ceb49020974e89b264c2a874dd82cf&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=41a3de4f5213430bb14205f0f3aabadc => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:32.169396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c803b91-48ec-4835-b31c-41df18eb21ab None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:32.181419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:32.225854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:32.230305 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366c80e-41ec-4945-bc86-ec2b2f260f07 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:32.271572 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2330e3e-48a4-4451-9f1b-b9ff29e7cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:32.272463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2330e3e-48a4-4451-9f1b-b9ff29e7cd5a None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:32.272725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2330e3e-48a4-4451-9f1b-b9ff29e7cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:32.273066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2330e3e-48a4-4451-9f1b-b9ff29e7cd5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:32.284245 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2330e3e-48a4-4451-9f1b-b9ff29e7cd5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:32.285701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2330e3e-48a4-4451-9f1b-b9ff29e7cd5a None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:32.287626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c803b91-48ec-4835-b31c-41df18eb21ab None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-e2330e3e-48a4-4451-9f1b-b9ff29e7cd5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:32.303027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:32.304069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:32.304953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:32.304953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:32.304953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:32.304953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:32.304953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 336/674] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:32.305512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2330e3e-48a4-4451-9f1b-b9ff29e7cd5a None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:32.337873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d058c-3b42-4f21-9bed-17a4342c6c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:32.339088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d058c-3b42-4f21-9bed-17a4342c6c57 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:32.339371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d058c-3b42-4f21-9bed-17a4342c6c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:32.339842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d058c-3b42-4f21-9bed-17a4342c6c57 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:32.340931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d058c-3b42-4f21-9bed-17a4342c6c57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:32.341264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d058c-3b42-4f21-9bed-17a4342c6c57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:32.342696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d058c-3b42-4f21-9bed-17a4342c6c57 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:32.357727 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 339/675] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:32.360059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31392a0-7ce5-439e-bd24-f2a529c15e5b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:32.360348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31392a0-7ce5-439e-bd24-f2a529c15e5b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:32.360756 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31392a0-7ce5-439e-bd24-f2a529c15e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:32.381284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d31392a0-7ce5-439e-bd24-f2a529c15e5b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:32.382489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d31392a0-7ce5-439e-bd24-f2a529c15e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:32.420403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2330e3e-48a4-4451-9f1b-b9ff29e7cd5a None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:32.460240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c6dde-9783-40a3-84c7-9ba09712ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:32.460871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c6dde-9783-40a3-84c7-9ba09712ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:32.461152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c6dde-9783-40a3-84c7-9ba09712ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:32.461621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c6dde-9783-40a3-84c7-9ba09712ccf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:32.462141 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c6dde-9783-40a3-84c7-9ba09712ccf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:32.462445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c6dde-9783-40a3-84c7-9ba09712ccf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:32.463829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c6dde-9783-40a3-84c7-9ba09712ccf5 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:32.464294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:32.479774 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 340/676] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:32.479774 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31392a0-7ce5-439e-bd24-f2a529c15e5b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:32.480055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 337/677] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:32.480055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c6dde-9783-40a3-84c7-9ba09712ccf5 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:32.496675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:32.592182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c6dde-9783-40a3-84c7-9ba09712ccf5 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:32.597956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31392a0-7ce5-439e-bd24-f2a529c15e5b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:32.632176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8cbc-e3a5-4996-b2fb-f2fa1a095281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:32.632711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8cbc-e3a5-4996-b2fb-f2fa1a095281 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:32.633008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8cbc-e3a5-4996-b2fb-f2fa1a095281 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:32.633253 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8cbc-e3a5-4996-b2fb-f2fa1a095281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:32.634032 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a8cbc-e3a5-4996-b2fb-f2fa1a095281 None admin] RBAC: Adding query filter params (role.id=41a3de4f5213430bb14205f0f3aabadc, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=8ed104145f1f4a3aa76659ae6ceac4ef) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:32.634371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a8cbc-e3a5-4996-b2fb-f2fa1a095281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:32.635168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484ffa4-3d0f-4639-8a18-dd598f4f6cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:32.635800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a8cbc-e3a5-4996-b2fb-f2fa1a095281 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:32.635914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484ffa4-3d0f-4639-8a18-dd598f4f6cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:32.636099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484ffa4-3d0f-4639-8a18-dd598f4f6cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:32.636436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484ffa4-3d0f-4639-8a18-dd598f4f6cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:32.637338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484ffa4-3d0f-4639-8a18-dd598f4f6cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:32.637661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484ffa4-3d0f-4639-8a18-dd598f4f6cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:32.639010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484ffa4-3d0f-4639-8a18-dd598f4f6cd9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:32.642218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 338/678] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:32 2022] GET /identity/v3/role_assignments?user.id=8ed104145f1f4a3aa76659ae6ceac4ef&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=41a3de4f5213430bb14205f0f3aabadc => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:32.643355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8cbc-e3a5-4996-b2fb-f2fa1a095281 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:32.663895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 341/679] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:32.664905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484ffa4-3d0f-4639-8a18-dd598f4f6cd9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:32.742535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:32.780124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:32.798079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484ffa4-3d0f-4639-8a18-dd598f4f6cd9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:32.800200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8cbc-e3a5-4996-b2fb-f2fa1a095281 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:32.844619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b92329-89a6-4f13-bc16-7653d0666e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:32.845300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b92329-89a6-4f13-bc16-7653d0666e6d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:32.845583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b92329-89a6-4f13-bc16-7653d0666e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:32.845858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b92329-89a6-4f13-bc16-7653d0666e6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:32.846916 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b7f71-a920-48d6-a8ca-18d726557cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:32.847981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7f71-a920-48d6-a8ca-18d726557cee None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:32.848451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7f71-a920-48d6-a8ca-18d726557cee None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:32.848921 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b7f71-a920-48d6-a8ca-18d726557cee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:32.858460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b92329-89a6-4f13-bc16-7653d0666e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:32.859928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b92329-89a6-4f13-bc16-7653d0666e6d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:32.860591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b7f71-a920-48d6-a8ca-18d726557cee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-bb5b7f71-a920-48d6-a8ca-18d726557cee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:32.867380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:32.868466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:32.869479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:32.869479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:32.869479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:32.869479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:32.869479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:32.869479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:32.869479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:32.869479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:32.869479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:32.869479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:32.869479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:32.869479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:32.870194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 342/680] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:25:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:32.870282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b7f71-a920-48d6-a8ca-18d726557cee None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-46b92329-89a6-4f13-bc16-7653d0666e6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:32.882546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:32.883634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:32.884805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:32.884805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:32.884805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:32.884805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:32.884805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 339/681] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:32.886524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b92329-89a6-4f13-bc16-7653d0666e6d None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:32.998959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b7f71-a920-48d6-a8ca-18d726557cee None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:33.018726 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:33.020751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b92329-89a6-4f13-bc16-7653d0666e6d None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:33.037735 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28971cc-e19d-4204-a658-01e368531b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:33.038490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28971cc-e19d-4204-a658-01e368531b0d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:33.038854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28971cc-e19d-4204-a658-01e368531b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:33.039202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28971cc-e19d-4204-a658-01e368531b0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:33.046434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28971cc-e19d-4204-a658-01e368531b0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:33.048357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28971cc-e19d-4204-a658-01e368531b0d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:33.057570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-a28971cc-e19d-4204-a658-01e368531b0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:33.062104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:33.063099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:33.064055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:33.064055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:33.064055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:33.064055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:33.064055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:33.064055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:33.064055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:33.064055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:33.064494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 343/682] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:33.064725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d7122-d016-472d-ba35-3b56b343cb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:33.066324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28971cc-e19d-4204-a658-01e368531b0d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:33.069993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7122-d016-472d-ba35-3b56b343cb13 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:33.069993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7122-d016-472d-ba35-3b56b343cb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:33.069993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7122-d016-472d-ba35-3b56b343cb13 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:33.069993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d7122-d016-472d-ba35-3b56b343cb13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:33.069993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d7122-d016-472d-ba35-3b56b343cb13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:33.071310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d7122-d016-472d-ba35-3b56b343cb13 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:33.083364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 340/683] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:33.084365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d7122-d016-472d-ba35-3b56b343cb13 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:33.187851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28971cc-e19d-4204-a658-01e368531b0d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:33.227003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefdf70-ff26-4296-b3b2-05c8c09d4798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:33.227909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefdf70-ff26-4296-b3b2-05c8c09d4798 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:33.228202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefdf70-ff26-4296-b3b2-05c8c09d4798 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:33.228478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefdf70-ff26-4296-b3b2-05c8c09d4798 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:33.229728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefdf70-ff26-4296-b3b2-05c8c09d4798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:33.230160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefdf70-ff26-4296-b3b2-05c8c09d4798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:33.231542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefdf70-ff26-4296-b3b2-05c8c09d4798 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:33.231929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d7122-d016-472d-ba35-3b56b343cb13 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:33.249170 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 344/684] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:33.250024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefdf70-ff26-4296-b3b2-05c8c09d4798 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:33.277712 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a355d-5a43-4774-addc-9bc684148097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:33.278337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a355d-5a43-4774-addc-9bc684148097 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:33.278622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a355d-5a43-4774-addc-9bc684148097 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:33.278895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a355d-5a43-4774-addc-9bc684148097 None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:33.279644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a355d-5a43-4774-addc-9bc684148097 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:33.280521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a355d-5a43-4774-addc-9bc684148097 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:33.282267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a355d-5a43-4774-addc-9bc684148097 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:33.299566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 341/685] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:33.300570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:33.300697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a355d-5a43-4774-addc-9bc684148097 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:33.366307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:33.370984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefdf70-ff26-4296-b3b2-05c8c09d4798 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:33.415405 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db089b3-e626-4eec-859f-0bf6b7c20860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:33.416203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db089b3-e626-4eec-859f-0bf6b7c20860 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:33.416563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db089b3-e626-4eec-859f-0bf6b7c20860 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:33.416908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db089b3-e626-4eec-859f-0bf6b7c20860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:33.429106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db089b3-e626-4eec-859f-0bf6b7c20860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:33.430656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db089b3-e626-4eec-859f-0bf6b7c20860 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:33.433873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a355d-5a43-4774-addc-9bc684148097 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-1db089b3-e626-4eec-859f-0bf6b7c20860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:33.447347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:33.449184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:33.451124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:33.451124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:33.451124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:33.451124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:33.451124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 345/686] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:33.451124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db089b3-e626-4eec-859f-0bf6b7c20860 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:33.480850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab5829-b8e8-4720-9ee7-e6d4d51bccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:33.481985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab5829-b8e8-4720-9ee7-e6d4d51bccc6 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:33.482599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab5829-b8e8-4720-9ee7-e6d4d51bccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:33.482936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab5829-b8e8-4720-9ee7-e6d4d51bccc6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:33.494448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab5829-b8e8-4720-9ee7-e6d4d51bccc6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:33.496450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab5829-b8e8-4720-9ee7-e6d4d51bccc6 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-18ab5829-b8e8-4720-9ee7-e6d4d51bccc6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:33.513351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:33.515259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:33.516938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:33.516938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:33.516938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:33.516938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:33.516938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:33.516938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:33.516938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:33.516938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:33.516938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 21:25:33.516938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:33.516938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 342/687] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:25:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:33.516938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab5829-b8e8-4720-9ee7-e6d4d51bccc6 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:33.559630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:33.571265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db089b3-e626-4eec-859f-0bf6b7c20860 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:33.621470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caacb9c-bcb8-47c5-bd53-3315f2ca19ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:33.622848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caacb9c-bcb8-47c5-bd53-3315f2ca19ad None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:33.623316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caacb9c-bcb8-47c5-bd53-3315f2ca19ad None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:33.623764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caacb9c-bcb8-47c5-bd53-3315f2ca19ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:33.625270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caacb9c-bcb8-47c5-bd53-3315f2ca19ad None admin] RBAC: Adding query filter params (role.id=41a3de4f5213430bb14205f0f3aabadc, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=b428f7d0d62049cf8fbbd05830d0d356) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:33.625752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caacb9c-bcb8-47c5-bd53-3315f2ca19ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:33.628593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caacb9c-bcb8-47c5-bd53-3315f2ca19ad None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:33.637622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 346/688] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:33 2022] GET /identity/v3/role_assignments?user.id=b428f7d0d62049cf8fbbd05830d0d356&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=41a3de4f5213430bb14205f0f3aabadc => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:33.638675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caacb9c-bcb8-47c5-bd53-3315f2ca19ad None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:33.652522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab5829-b8e8-4720-9ee7-e6d4d51bccc6 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:33.686891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:33.765142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b146d-b920-4902-af57-e2464f188f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:33.765879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b146d-b920-4902-af57-e2464f188f46 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:33.766174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b146d-b920-4902-af57-e2464f188f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:33.766449 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b146d-b920-4902-af57-e2464f188f46 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:33.767165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b146d-b920-4902-af57-e2464f188f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:33.767475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b146d-b920-4902-af57-e2464f188f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:33.769570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b146d-b920-4902-af57-e2464f188f46 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:33.781059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caacb9c-bcb8-47c5-bd53-3315f2ca19ad None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:33.797833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 343/689] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:33.803825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b146d-b920-4902-af57-e2464f188f46 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:33.823868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641ada9-7294-45af-b839-9f79fb71dd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:33.824516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641ada9-7294-45af-b839-9f79fb71dd24 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:33.824802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641ada9-7294-45af-b839-9f79fb71dd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:33.825078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641ada9-7294-45af-b839-9f79fb71dd24 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:33.825908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641ada9-7294-45af-b839-9f79fb71dd24 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:33.826218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641ada9-7294-45af-b839-9f79fb71dd24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:33.827702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641ada9-7294-45af-b839-9f79fb71dd24 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:33.851779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 347/690] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 25 21:25:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:33.857907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641ada9-7294-45af-b839-9f79fb71dd24 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:33.878051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:33.967905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b146d-b920-4902-af57-e2464f188f46 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:34.009571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641ada9-7294-45af-b839-9f79fb71dd24 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:34.010466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab67c9-1d8b-4b76-a002-6f16ac4feca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:34.011270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab67c9-1d8b-4b76-a002-6f16ac4feca7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:34.011560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab67c9-1d8b-4b76-a002-6f16ac4feca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:34.011869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab67c9-1d8b-4b76-a002-6f16ac4feca7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:34.022760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab67c9-1d8b-4b76-a002-6f16ac4feca7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:34.024232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab67c9-1d8b-4b76-a002-6f16ac4feca7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-94ab67c9-1d8b-4b76-a002-6f16ac4feca7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:34.039251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:34.041317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:34.042556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:34.042556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:34.042556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:34.042556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:34.042556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:34.042556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:34.042556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:34.042556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:34.042556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:25:34.042556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:34.042556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 344/691] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 21:25:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:34.048672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab67c9-1d8b-4b76-a002-6f16ac4feca7 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:34.051811 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75267f33-2fd3-4b6a-9175-cf33b6c4e342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:34.052730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75267f33-2fd3-4b6a-9175-cf33b6c4e342 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:34.053019 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75267f33-2fd3-4b6a-9175-cf33b6c4e342 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:34.053295 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75267f33-2fd3-4b6a-9175-cf33b6c4e342 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:34.085086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:34.147097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75267f33-2fd3-4b6a-9175-cf33b6c4e342 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:34.148614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75267f33-2fd3-4b6a-9175-cf33b6c4e342 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:34.164630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab67c9-1d8b-4b76-a002-6f16ac4feca7 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:34.209789 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0365b-824f-4527-bf67-04e057dd1d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:34.210436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0365b-824f-4527-bf67-04e057dd1d83 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:34.210717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0365b-824f-4527-bf67-04e057dd1d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:34.210989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0365b-824f-4527-bf67-04e057dd1d83 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:34.211862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0365b-824f-4527-bf67-04e057dd1d83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:34.212173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0365b-824f-4527-bf67-04e057dd1d83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:34.213643 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0365b-824f-4527-bf67-04e057dd1d83 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:34.234771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 345/692] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 21:25:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:34.245160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0365b-824f-4527-bf67-04e057dd1d83 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:34.282638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:34.419569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:34.423227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 348/693] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:25:34.429981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75267f33-2fd3-4b6a-9175-cf33b6c4e342 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:34.441399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0365b-824f-4527-bf67-04e057dd1d83 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:34.486576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1217957-517d-428e-b8bf-b9831f3a15db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:34.487757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217957-517d-428e-b8bf-b9831f3a15db None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:34.488480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217957-517d-428e-b8bf-b9831f3a15db None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:34.488759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1217957-517d-428e-b8bf-b9831f3a15db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:34.551267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75267f33-2fd3-4b6a-9175-cf33b6c4e342 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:34.567575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:34.573857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1217957-517d-428e-b8bf-b9831f3a15db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:34.575718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1217957-517d-428e-b8bf-b9831f3a15db None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:34.592675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c72a84-5c51-472f-ad9c-1a61cc0864a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:34.593600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c72a84-5c51-472f-ad9c-1a61cc0864a6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:34.593883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c72a84-5c51-472f-ad9c-1a61cc0864a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:34.594156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c72a84-5c51-472f-ad9c-1a61cc0864a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:34.608107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c72a84-5c51-472f-ad9c-1a61cc0864a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:34.609945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c72a84-5c51-472f-ad9c-1a61cc0864a6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-15c72a84-5c51-472f-ad9c-1a61cc0864a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:34.630105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:34.631659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:34.632624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:34.632624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:34.632624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:34.632624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:34.635984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 349/694] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:34.637566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaec22f-350f-45e4-b495-ca95466b3c8d None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:34.637858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaec22f-350f-45e4-b495-ca95466b3c8d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:34.638247 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaec22f-350f-45e4-b495-ca95466b3c8d None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:34.639774 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 350/695] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:34.640477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaec22f-350f-45e4-b495-ca95466b3c8d None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:34.696388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:34.709461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 346/696] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 21:25:34.711300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478d9d-81ca-4b7a-9d40-be2f12d1313a None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:34.711850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478d9d-81ca-4b7a-9d40-be2f12d1313a None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:34.712357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c478d9d-81ca-4b7a-9d40-be2f12d1313a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:34.730981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-9c478d9d-81ca-4b7a-9d40-be2f12d1313a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:34.733552 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-9c478d9d-81ca-4b7a-9d40-be2f12d1313a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:34.782444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaec22f-350f-45e4-b495-ca95466b3c8d None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:34.808346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 347/697] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:34.809627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c478d9d-81ca-4b7a-9d40-be2f12d1313a None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:34.831733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f328b-e062-45c8-8073-ea1aa8dccf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:34.832398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f328b-e062-45c8-8073-ea1aa8dccf22 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:34.832681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f328b-e062-45c8-8073-ea1aa8dccf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:34.832954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f328b-e062-45c8-8073-ea1aa8dccf22 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:34.835156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f328b-e062-45c8-8073-ea1aa8dccf22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:34.835156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f328b-e062-45c8-8073-ea1aa8dccf22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:34.835647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f328b-e062-45c8-8073-ea1aa8dccf22 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:34.849628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 351/698] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:34.855260 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f328b-e062-45c8-8073-ea1aa8dccf22 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:34.887946 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:34.938257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c478d9d-81ca-4b7a-9d40-be2f12d1313a None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:34.959649 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:34.974864 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196d9be-6f96-48d5-ad5c-19824c495827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:34.975508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196d9be-6f96-48d5-ad5c-19824c495827 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:34.975813 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196d9be-6f96-48d5-ad5c-19824c495827 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:34.976147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196d9be-6f96-48d5-ad5c-19824c495827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:34.977236 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f328b-e062-45c8-8073-ea1aa8dccf22 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:34.989268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196d9be-6f96-48d5-ad5c-19824c495827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:34.990844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196d9be-6f96-48d5-ad5c-19824c495827 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-8196d9be-6f96-48d5-ad5c-19824c495827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:35.007049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:35.007970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:35.008843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:35.008843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:35.008843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:35.008843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:35.008843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 348/699] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:35.009124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196d9be-6f96-48d5-ad5c-19824c495827 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:35.020088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032b5a-3b1a-47ad-a249-5ce86b4d0685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:35.020750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032b5a-3b1a-47ad-a249-5ce86b4d0685 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:35.021021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032b5a-3b1a-47ad-a249-5ce86b4d0685 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:35.021297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032b5a-3b1a-47ad-a249-5ce86b4d0685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:35.032969 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18032b5a-3b1a-47ad-a249-5ce86b4d0685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:35.034549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18032b5a-3b1a-47ad-a249-5ce86b4d0685 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-18032b5a-3b1a-47ad-a249-5ce86b4d0685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:35.051486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:35.052461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:35.053362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:35.053362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:35.053362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:35.053362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:35.053362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 352/700] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:35.054535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a25337-20de-48da-a7b7-c6d9f13435b7 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:35.054535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a25337-20de-48da-a7b7-c6d9f13435b7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:35.054535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a25337-20de-48da-a7b7-c6d9f13435b7 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:35.060163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 353/701] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:35.060163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a25337-20de-48da-a7b7-c6d9f13435b7 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:35.120768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196d9be-6f96-48d5-ad5c-19824c495827 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:35.143259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:35.155473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9957d9-ce42-4707-bbe4-257788eba743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:35.156153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9957d9-ce42-4707-bbe4-257788eba743 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:35.156437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9957d9-ce42-4707-bbe4-257788eba743 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:35.156709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9957d9-ce42-4707-bbe4-257788eba743 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:35.164280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9957d9-ce42-4707-bbe4-257788eba743 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:35.165716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9957d9-ce42-4707-bbe4-257788eba743 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:35.168907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a25337-20de-48da-a7b7-c6d9f13435b7 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-4c9957d9-ce42-4707-bbe4-257788eba743 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:35.177787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:35.178699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:35.179634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:35.179634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:35.179634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:35.179634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:35.179634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:35.179634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:35.179634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:35.179634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:35.183773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 349/702] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:35.184520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9957d9-ce42-4707-bbe4-257788eba743 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:35.211137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91eb20-ef59-4ade-878f-bc6dcdb9b2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:35.211809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91eb20-ef59-4ade-878f-bc6dcdb9b2dd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:35.212096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91eb20-ef59-4ade-878f-bc6dcdb9b2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:35.212370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91eb20-ef59-4ade-878f-bc6dcdb9b2dd None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:35.213092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91eb20-ef59-4ade-878f-bc6dcdb9b2dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:35.213401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91eb20-ef59-4ade-878f-bc6dcdb9b2dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:35.214948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91eb20-ef59-4ade-878f-bc6dcdb9b2dd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:35.219372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:35.232588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 354/703] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:35.232588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043409a-770a-46b1-b2c4-93d9e163fac8 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:35.232588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043409a-770a-46b1-b2c4-93d9e163fac8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:35.232588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043409a-770a-46b1-b2c4-93d9e163fac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:35.249881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-0043409a-770a-46b1-b2c4-93d9e163fac8 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:35.251098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0043409a-770a-46b1-b2c4-93d9e163fac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:35.298593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9957d9-ce42-4707-bbe4-257788eba743 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:35.324040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 355/704] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:35.324804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043409a-770a-46b1-b2c4-93d9e163fac8 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:35.343314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9dd1d-f8f7-4652-a036-4429a7eed99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:35.344323 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9dd1d-f8f7-4652-a036-4429a7eed99c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:35.344789 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9dd1d-f8f7-4652-a036-4429a7eed99c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:35.345295 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9dd1d-f8f7-4652-a036-4429a7eed99c None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:35.346859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9dd1d-f8f7-4652-a036-4429a7eed99c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:35.347424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9dd1d-f8f7-4652-a036-4429a7eed99c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:35.349023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9dd1d-f8f7-4652-a036-4429a7eed99c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:35.360998 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 350/705] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:35.362603 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9dd1d-f8f7-4652-a036-4429a7eed99c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:35.400713 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:35.436360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043409a-770a-46b1-b2c4-93d9e163fac8 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:35.461973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:35.471551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9dd1d-f8f7-4652-a036-4429a7eed99c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:35.472835 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55189598-9c23-4932-9ea0-204f478e64c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:35.473464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55189598-9c23-4932-9ea0-204f478e64c5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:35.473745 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55189598-9c23-4932-9ea0-204f478e64c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:35.474016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55189598-9c23-4932-9ea0-204f478e64c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:35.474779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55189598-9c23-4932-9ea0-204f478e64c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:35.475120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55189598-9c23-4932-9ea0-204f478e64c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:35.476551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55189598-9c23-4932-9ea0-204f478e64c5 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:35.488816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 356/706] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:35.489622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55189598-9c23-4932-9ea0-204f478e64c5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:35.515980 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c230497-9b0a-4f96-9da1-945789309989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:35.516650 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c230497-9b0a-4f96-9da1-945789309989 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:35.516924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c230497-9b0a-4f96-9da1-945789309989 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:35.517194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c230497-9b0a-4f96-9da1-945789309989 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:35.525107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c230497-9b0a-4f96-9da1-945789309989 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:35.526535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c230497-9b0a-4f96-9da1-945789309989 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-0c230497-9b0a-4f96-9da1-945789309989 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:35.540163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:35.541126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:35.542039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:35.542039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:35.542039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:35.542039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:35.542039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:35.542039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:35.542039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:35.542039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:35.542039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 351/707] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:35.542556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c230497-9b0a-4f96-9da1-945789309989 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:35.601486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55189598-9c23-4932-9ea0-204f478e64c5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:35.628546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:35.637148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cae9c-3ab3-4456-8194-b766191a135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:35.637858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cae9c-3ab3-4456-8194-b766191a135c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:35.641076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cae9c-3ab3-4456-8194-b766191a135c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:35.641076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cae9c-3ab3-4456-8194-b766191a135c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:35.641076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cae9c-3ab3-4456-8194-b766191a135c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:35.641076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cae9c-3ab3-4456-8194-b766191a135c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-8c0cae9c-3ab3-4456-8194-b766191a135c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:35.651631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:35.652720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:35.653617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 357/708] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Jul 25 21:25:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:35.654519 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cae9c-3ab3-4456-8194-b766191a135c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:35.663920 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c230497-9b0a-4f96-9da1-945789309989 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:35.703730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ed617-1278-4d85-88b5-f8ea136a716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:35.704378 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ed617-1278-4d85-88b5-f8ea136a716c None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:35.704654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ed617-1278-4d85-88b5-f8ea136a716c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:35.704924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ed617-1278-4d85-88b5-f8ea136a716c None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:35.707005 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ed617-1278-4d85-88b5-f8ea136a716c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:35.708458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ed617-1278-4d85-88b5-f8ea136a716c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:35.764223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cae9c-3ab3-4456-8194-b766191a135c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:35.803770 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 352/709] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:25:35 2022] POST /identity/v3/users => generated 254 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:25:35.803770 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ed617-1278-4d85-88b5-f8ea136a716c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:35.807254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdfe93-2547-4184-b6b8-748d4533d29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:35.808134 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdfe93-2547-4184-b6b8-748d4533d29a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:35.808422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdfe93-2547-4184-b6b8-748d4533d29a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:35.808697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdfe93-2547-4184-b6b8-748d4533d29a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:35.809522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdfe93-2547-4184-b6b8-748d4533d29a None admin] RBAC: Adding query filter params (role.id=41a3de4f5213430bb14205f0f3aabadc, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=4c4863a61a484ed4b0dac01e908cd05a) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:35.809829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdfe93-2547-4184-b6b8-748d4533d29a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:35.811298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdfe93-2547-4184-b6b8-748d4533d29a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:35.819721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:35.828143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 358/710] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:35 2022] GET /identity/v3/role_assignments?user.id=4c4863a61a484ed4b0dac01e908cd05a&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=41a3de4f5213430bb14205f0f3aabadc => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:35.829204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdfe93-2547-4184-b6b8-748d4533d29a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:35.948705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:35.980162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ed617-1278-4d85-88b5-f8ea136a716c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:36.006553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdfe93-2547-4184-b6b8-748d4533d29a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:36.041837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574bcb5-ed68-4556-a250-4e8a5b3303b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:36.042485 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574bcb5-ed68-4556-a250-4e8a5b3303b1 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:36.042770 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574bcb5-ed68-4556-a250-4e8a5b3303b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:36.043046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574bcb5-ed68-4556-a250-4e8a5b3303b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:36.045747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574bcb5-ed68-4556-a250-4e8a5b3303b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:36.046093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574bcb5-ed68-4556-a250-4e8a5b3303b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:36.047576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574bcb5-ed68-4556-a250-4e8a5b3303b1 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:36.055346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81a002-d3b2-457f-ba19-f81c907aac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:36.056410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a002-d3b2-457f-ba19-f81c907aac9d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:36.057007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a002-d3b2-457f-ba19-f81c907aac9d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:36.057486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a002-d3b2-457f-ba19-f81c907aac9d None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:36.058412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81a002-d3b2-457f-ba19-f81c907aac9d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:36.059168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81a002-d3b2-457f-ba19-f81c907aac9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:36.060845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81a002-d3b2-457f-ba19-f81c907aac9d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:36.066710 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 353/711] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:36.071313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574bcb5-ed68-4556-a250-4e8a5b3303b1 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:36.074240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 359/712] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 25 21:25:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:36.076480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81a002-d3b2-457f-ba19-f81c907aac9d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:36.147221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:36.188076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574bcb5-ed68-4556-a250-4e8a5b3303b1 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:36.197931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81a002-d3b2-457f-ba19-f81c907aac9d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:36.216855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:36.225991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4b4c5-2003-4bed-a85a-a3e60fc370fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:36.226696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4b4c5-2003-4bed-a85a-a3e60fc370fe None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:36.226984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4b4c5-2003-4bed-a85a-a3e60fc370fe None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:36.227315 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4b4c5-2003-4bed-a85a-a3e60fc370fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:36.228163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4b4c5-2003-4bed-a85a-a3e60fc370fe None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=7d3d6613476c445b82302df5025f3ce6) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:36.228481 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4b4c5-2003-4bed-a85a-a3e60fc370fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:36.231087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4b4c5-2003-4bed-a85a-a3e60fc370fe None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:36.235089 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8f45e-3870-41ec-a3ef-90bb910f6e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:36.235715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8f45e-3870-41ec-a3ef-90bb910f6e0f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:36.236035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8f45e-3870-41ec-a3ef-90bb910f6e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:36.236157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 354/713] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:36 2022] GET /identity/v3/role_assignments?user.id=7d3d6613476c445b82302df5025f3ce6&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:36.236321 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8f45e-3870-41ec-a3ef-90bb910f6e0f None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:36.237607 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8f45e-3870-41ec-a3ef-90bb910f6e0f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:36.237917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8f45e-3870-41ec-a3ef-90bb910f6e0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:36.238089 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e0d69-41a7-4301-ba6e-1e90ba397967 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:36.238395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e0d69-41a7-4301-ba6e-1e90ba397967 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:36.238668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e0d69-41a7-4301-ba6e-1e90ba397967 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:36.239296 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8f45e-3870-41ec-a3ef-90bb910f6e0f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:36.240274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 355/714] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:36.246139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3dc7f-4273-47c5-bd95-9238e01ee297 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:36.246331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 360/715] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 25 21:25:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:36.246439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3dc7f-4273-47c5-bd95-9238e01ee297 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:36.246695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3dc7f-4273-47c5-bd95-9238e01ee297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:36.270858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-b5d3dc7f-4273-47c5-bd95-9238e01ee297 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:36.272338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-b5d3dc7f-4273-47c5-bd95-9238e01ee297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:36.352225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 356/716] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:25:36.375445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8f45e-3870-41ec-a3ef-90bb910f6e0f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:36.510069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8f45e-3870-41ec-a3ef-90bb910f6e0f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:36.546955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5de35d-bf36-40bf-8186-3e0336c2adc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:36.547602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5de35d-bf36-40bf-8186-3e0336c2adc0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:36.547914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5de35d-bf36-40bf-8186-3e0336c2adc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:36.548190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5de35d-bf36-40bf-8186-3e0336c2adc0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:36.548830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5de35d-bf36-40bf-8186-3e0336c2adc0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:36.551163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5de35d-bf36-40bf-8186-3e0336c2adc0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-cf5de35d-bf36-40bf-8186-3e0336c2adc0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:36.560529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:36.563777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:36.564651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 361/717] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:36 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:36.572408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3dc7f-4273-47c5-bd95-9238e01ee297 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:36.639216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:36.692944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3dc7f-4273-47c5-bd95-9238e01ee297 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:36.739415 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160eb63-0af5-4c03-afe8-27cdd072c955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:36.740085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160eb63-0af5-4c03-afe8-27cdd072c955 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:36.740372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160eb63-0af5-4c03-afe8-27cdd072c955 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:36.740647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160eb63-0af5-4c03-afe8-27cdd072c955 None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:36.741344 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160eb63-0af5-4c03-afe8-27cdd072c955 None admin] RBAC: Adding query filter params (name=network) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:36.741657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160eb63-0af5-4c03-afe8-27cdd072c955 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:36.743020 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160eb63-0af5-4c03-afe8-27cdd072c955 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:36.747919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 357/718] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 21:25:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:36.754197 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5de35d-bf36-40bf-8186-3e0336c2adc0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:36.843811 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:36.919579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5de35d-bf36-40bf-8186-3e0336c2adc0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:36.966348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298a6cc-d1a1-4929-9a9b-c24cb07c67bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:36.966987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298a6cc-d1a1-4929-9a9b-c24cb07c67bf None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:36.967272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298a6cc-d1a1-4929-9a9b-c24cb07c67bf None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:36.967548 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298a6cc-d1a1-4929-9a9b-c24cb07c67bf None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:36.968270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298a6cc-d1a1-4929-9a9b-c24cb07c67bf None admin] RBAC: Adding query filter params (type=network) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:36.968580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298a6cc-d1a1-4929-9a9b-c24cb07c67bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:36.969948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298a6cc-d1a1-4929-9a9b-c24cb07c67bf None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:36.980109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 362/719] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 21:25:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:38.442633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a8c4b-945e-4125-bef6-95438e0d6152 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:38.443142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a8c4b-945e-4125-bef6-95438e0d6152 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:38.443220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a8c4b-945e-4125-bef6-95438e0d6152 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:38.444823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 358/720] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:38.457472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f79205-de0e-452c-aec9-870cf490c2f5 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:38.457949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f79205-de0e-452c-aec9-870cf490c2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:38.458024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f79205-de0e-452c-aec9-870cf490c2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:38.493517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-47f79205-de0e-452c-aec9-870cf490c2f5 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:38.494743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-47f79205-de0e-452c-aec9-870cf490c2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:38.501124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb36440-6905-4f46-893e-c245be2e30da None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:38.501426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb36440-6905-4f46-893e-c245be2e30da None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:38.501685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb36440-6905-4f46-893e-c245be2e30da None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:38.503506 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 359/721] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:38.514933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dc3f9-680e-4be7-85c0-c0be721b50ca None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:38.515266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dc3f9-680e-4be7-85c0-c0be721b50ca None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:38.515493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dc3f9-680e-4be7-85c0-c0be721b50ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:38.543765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-136dc3f9-680e-4be7-85c0-c0be721b50ca None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:38.549649 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-136dc3f9-680e-4be7-85c0-c0be721b50ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:38.595049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 363/722] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:25:38.649186 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f79205-de0e-452c-aec9-870cf490c2f5 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:38.664306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 360/723] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 21:25:38.720257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:38.741473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136dc3f9-680e-4be7-85c0-c0be721b50ca None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:38.793272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f79205-de0e-452c-aec9-870cf490c2f5 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:38.831303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e5891-17d5-4b17-968f-04c4b78ae4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:38.832015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e5891-17d5-4b17-968f-04c4b78ae4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:38.832302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e5891-17d5-4b17-968f-04c4b78ae4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:38.832581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e5891-17d5-4b17-968f-04c4b78ae4e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:38.834336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:38.843232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e5891-17d5-4b17-968f-04c4b78ae4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-879e5891-17d5-4b17-968f-04c4b78ae4e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:38.848830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:38.854070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:38.854900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:38.854900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:38.854900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:38.854900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:38.854900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:38.854900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:38.854900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:38.854900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:38.854900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:38.854900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:38.854900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:38.854900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:38.854900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 364/724] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:38.854900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb06bd-2368-4fcf-b956-48b812652103 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:38.855635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb06bd-2368-4fcf-b956-48b812652103 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:38.855635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb06bd-2368-4fcf-b956-48b812652103 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:38.855635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 365/725] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:38.859538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb06bd-2368-4fcf-b956-48b812652103 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:38.897359 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136dc3f9-680e-4be7-85c0-c0be721b50ca None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:38.939081 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d59de-0fb3-4823-8c8a-de6cdc72d127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:38.940683 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d59de-0fb3-4823-8c8a-de6cdc72d127 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:38.941160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d59de-0fb3-4823-8c8a-de6cdc72d127 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:38.941435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d59de-0fb3-4823-8c8a-de6cdc72d127 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:38.952905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d59de-0fb3-4823-8c8a-de6cdc72d127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-269d59de-0fb3-4823-8c8a-de6cdc72d127 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:38.958290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:38.959285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:38.960561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:38.960561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:38.960561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:38.960561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:38.960561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:38.960561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:38.960561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:38.960561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:38.960561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:38.960561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:38.960561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:38.960561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:38.960561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 361/726] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:38.961256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec40e80-fa4e-4d67-a6c2-2275885e3f38 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:38.961256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec40e80-fa4e-4d67-a6c2-2275885e3f38 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:38.961377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec40e80-fa4e-4d67-a6c2-2275885e3f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:38.980006 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-6ec40e80-fa4e-4d67-a6c2-2275885e3f38 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:38.981195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-6ec40e80-fa4e-4d67-a6c2-2275885e3f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:38.985881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:38.990359 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb06bd-2368-4fcf-b956-48b812652103 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:39.027095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c24e41-bb27-4e47-8898-9b21ee1569c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:39.027772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c24e41-bb27-4e47-8898-9b21ee1569c3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:39.028064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c24e41-bb27-4e47-8898-9b21ee1569c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:39.028420 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c24e41-bb27-4e47-8898-9b21ee1569c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:39.029151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c24e41-bb27-4e47-8898-9b21ee1569c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:39.029457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c24e41-bb27-4e47-8898-9b21ee1569c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:39.030973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c24e41-bb27-4e47-8898-9b21ee1569c3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:39.044498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 366/727] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:39.044498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e945c2-e559-43fa-9642-6f7a02169082 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:39.044498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e945c2-e559-43fa-9642-6f7a02169082 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:39.044498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e945c2-e559-43fa-9642-6f7a02169082 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:39.044498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 367/728] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:39.044498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e945c2-e559-43fa-9642-6f7a02169082 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:39.073160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 362/729] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:39.074353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec40e80-fa4e-4d67-a6c2-2275885e3f38 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:39.134124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:39.169371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e945c2-e559-43fa-9642-6f7a02169082 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:39.190235 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec40e80-fa4e-4d67-a6c2-2275885e3f38 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:39.204411 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05b829-0dd6-46b5-a3ba-3a8d30363fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:39.204962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05b829-0dd6-46b5-a3ba-3a8d30363fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:39.205291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05b829-0dd6-46b5-a3ba-3a8d30363fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:39.206609 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05b829-0dd6-46b5-a3ba-3a8d30363fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:39.207336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05b829-0dd6-46b5-a3ba-3a8d30363fb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:39.207670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05b829-0dd6-46b5-a3ba-3a8d30363fb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:39.209061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05b829-0dd6-46b5-a3ba-3a8d30363fb9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:39.217131 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 368/730] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:39.218306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d99656-d412-4f3f-bb9f-180a56ec7f73 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:39.218592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d99656-d412-4f3f-bb9f-180a56ec7f73 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:39.218867 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d99656-d412-4f3f-bb9f-180a56ec7f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:39.233335 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c653d3b-c92e-4943-bc42-592ceac52dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:39.234209 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653d3b-c92e-4943-bc42-592ceac52dad None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:39.234674 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653d3b-c92e-4943-bc42-592ceac52dad None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:39.235119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653d3b-c92e-4943-bc42-592ceac52dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:39.238503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-b2d99656-d412-4f3f-bb9f-180a56ec7f73 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:39.239688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b2d99656-d412-4f3f-bb9f-180a56ec7f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:39.248416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c653d3b-c92e-4943-bc42-592ceac52dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:39.250363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c653d3b-c92e-4943-bc42-592ceac52dad None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:39.257534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-2c653d3b-c92e-4943-bc42-592ceac52dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:39.266072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:39.272462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:39.273580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:39.273580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:39.273580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:39.273580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:39.273580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 363/731] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:39.273580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c653d3b-c92e-4943-bc42-592ceac52dad None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:39.316332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 369/732] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:39.317439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d99656-d412-4f3f-bb9f-180a56ec7f73 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:39.386451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:39.390885 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c653d3b-c92e-4943-bc42-592ceac52dad None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:39.429523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d11cce-2fab-4968-874f-5fd307b1bfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:39.430145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d11cce-2fab-4968-874f-5fd307b1bfbb None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:39.430321 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d99656-d412-4f3f-bb9f-180a56ec7f73 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:39.430423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d11cce-2fab-4968-874f-5fd307b1bfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:39.430682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d11cce-2fab-4968-874f-5fd307b1bfbb None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:39.431376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d11cce-2fab-4968-874f-5fd307b1bfbb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:39.432761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d11cce-2fab-4968-874f-5fd307b1bfbb None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:39.465584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf582d-d7cf-4027-bce8-78ab55b0fb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:39.466155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf582d-d7cf-4027-bce8-78ab55b0fb17 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:39.466438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf582d-d7cf-4027-bce8-78ab55b0fb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:39.466715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf582d-d7cf-4027-bce8-78ab55b0fb17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:39.477665 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf582d-d7cf-4027-bce8-78ab55b0fb17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:39.479117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf582d-d7cf-4027-bce8-78ab55b0fb17 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-26cf582d-d7cf-4027-bce8-78ab55b0fb17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:39.493792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:39.494857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:39.495979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:39.495979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:39.495979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:39.495979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:39.495979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 370/733] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:39.495979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf582d-d7cf-4027-bce8-78ab55b0fb17 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:39.504692 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:39.533155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 364/734] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 21:25:39 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:25:39.534797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d11cce-2fab-4968-874f-5fd307b1bfbb None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:39.618266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf582d-d7cf-4027-bce8-78ab55b0fb17 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:39.666064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019e51f-edbd-4697-b2aa-35613ab15575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:39.666702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019e51f-edbd-4697-b2aa-35613ab15575 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:39.666986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019e51f-edbd-4697-b2aa-35613ab15575 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:39.667261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019e51f-edbd-4697-b2aa-35613ab15575 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:39.667387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d11cce-2fab-4968-874f-5fd307b1bfbb None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:39.668001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019e51f-edbd-4697-b2aa-35613ab15575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:39.668310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019e51f-edbd-4697-b2aa-35613ab15575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:39.669719 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019e51f-edbd-4697-b2aa-35613ab15575 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:39.685101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 371/735] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:39.685799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28520cf6-f797-4eff-a10b-13b7c2c08bfe None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:39.686686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28520cf6-f797-4eff-a10b-13b7c2c08bfe None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:39.686686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28520cf6-f797-4eff-a10b-13b7c2c08bfe None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:39.688065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 372/736] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:39.688537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28520cf6-f797-4eff-a10b-13b7c2c08bfe None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:39.716221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203a346-92b6-4765-abc4-5aa2a08dac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:39.717238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203a346-92b6-4765-abc4-5aa2a08dac51 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:39.717238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203a346-92b6-4765-abc4-5aa2a08dac51 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:39.717406 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203a346-92b6-4765-abc4-5aa2a08dac51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:39.729192 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203a346-92b6-4765-abc4-5aa2a08dac51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-d203a346-92b6-4765-abc4-5aa2a08dac51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:39.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:39.735028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:39.735982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:39.735982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:39.735982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:39.735982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:39.735982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:39.735982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:39.735982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:39.735982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:39.735982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:39.735982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:39.735982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:39.735982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:39.735982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 365/737] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:25:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:39.736762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203a346-92b6-4765-abc4-5aa2a08dac51 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:39.753799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:39.771242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:39.814470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28520cf6-f797-4eff-a10b-13b7c2c08bfe None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:39.841128 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203a346-92b6-4765-abc4-5aa2a08dac51 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:39.852484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fe4ec-86f8-417d-bd67-ab0c4a951179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:39.853133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe4ec-86f8-417d-bd67-ab0c4a951179 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:39.853425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe4ec-86f8-417d-bd67-ab0c4a951179 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:39.853705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe4ec-86f8-417d-bd67-ab0c4a951179 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:39.854406 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fe4ec-86f8-417d-bd67-ab0c4a951179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:39.854718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fe4ec-86f8-417d-bd67-ab0c4a951179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:39.856155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fe4ec-86f8-417d-bd67-ab0c4a951179 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:39.872511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 373/738] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:39.873805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17af5df-0291-4d3b-bced-8ffd3a1ec213 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:39.874100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17af5df-0291-4d3b-bced-8ffd3a1ec213 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:39.874381 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17af5df-0291-4d3b-bced-8ffd3a1ec213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:39.878475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29feff-2b4e-4f8c-bdb9-b2d9acdfe263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:39.879215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29feff-2b4e-4f8c-bdb9-b2d9acdfe263 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:39.879502 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29feff-2b4e-4f8c-bdb9-b2d9acdfe263 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:39.879821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29feff-2b4e-4f8c-bdb9-b2d9acdfe263 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:39.887558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29feff-2b4e-4f8c-bdb9-b2d9acdfe263 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:39.889476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29feff-2b4e-4f8c-bdb9-b2d9acdfe263 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:39.894956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e17af5df-0291-4d3b-bced-8ffd3a1ec213 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:39.896201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e17af5df-0291-4d3b-bced-8ffd3a1ec213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-6a29feff-2b4e-4f8c-bdb9-b2d9acdfe263 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:39.903053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:39.903991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:39.904894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:39.904894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:39.904894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:39.904894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:39.904894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:39.904894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:39.904894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:39.904894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:39.904894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 21:25:39.904894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:39.905408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 366/739] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:25:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:39.906001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29feff-2b4e-4f8c-bdb9-b2d9acdfe263 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:39.972183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 374/740] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 21:25:39.972947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17af5df-0291-4d3b-bced-8ffd3a1ec213 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:40.004120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:40.031901 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29feff-2b4e-4f8c-bdb9-b2d9acdfe263 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:40.034972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:40.069748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc971a-7e6a-400a-a693-2557e46d8359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:40.070376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc971a-7e6a-400a-a693-2557e46d8359 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:40.070658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc971a-7e6a-400a-a693-2557e46d8359 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:40.070937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc971a-7e6a-400a-a693-2557e46d8359 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:40.072108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc971a-7e6a-400a-a693-2557e46d8359 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:40.072418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc971a-7e6a-400a-a693-2557e46d8359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:40.073796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc971a-7e6a-400a-a693-2557e46d8359 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:40.083770 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 367/741] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:40.084584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc971a-7e6a-400a-a693-2557e46d8359 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:40.089329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17af5df-0291-4d3b-bced-8ffd3a1ec213 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:40.128011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c104682-3e35-4c66-9924-5741463c9725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:40.128651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c104682-3e35-4c66-9924-5741463c9725 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:40.128934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c104682-3e35-4c66-9924-5741463c9725 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:40.129200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c104682-3e35-4c66-9924-5741463c9725 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:40.136792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c104682-3e35-4c66-9924-5741463c9725 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:40.138220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c104682-3e35-4c66-9924-5741463c9725 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-4c104682-3e35-4c66-9924-5741463c9725 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:40.150820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:40.151966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:40.152927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:40.152927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:40.152927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:40.152927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:40.152927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:40.152927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:40.152927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:40.152927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:40.152927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 21:25:40.152927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:40.152927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 375/742] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 21:25:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:40.152927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c104682-3e35-4c66-9924-5741463c9725 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:40.196333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc971a-7e6a-400a-a693-2557e46d8359 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:40.233000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3f978-3d90-41a6-8133-8860f35f2ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:40.233540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3f978-3d90-41a6-8133-8860f35f2ffd None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:40.233827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3f978-3d90-41a6-8133-8860f35f2ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:40.234098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3f978-3d90-41a6-8133-8860f35f2ffd None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:40.235300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3f978-3d90-41a6-8133-8860f35f2ffd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:40.235609 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3f978-3d90-41a6-8133-8860f35f2ffd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:40.237701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3f978-3d90-41a6-8133-8860f35f2ffd None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:40.240664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:40.257294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 368/743] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 25 21:25:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:40.258321 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3f978-3d90-41a6-8133-8860f35f2ffd None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:40.270057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c104682-3e35-4c66-9924-5741463c9725 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:40.283115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:40.306022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3c2b2-4644-4d45-adf3-40a7b749a304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:40.306647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3c2b2-4644-4d45-adf3-40a7b749a304 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:40.306931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3c2b2-4644-4d45-adf3-40a7b749a304 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:40.307211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3c2b2-4644-4d45-adf3-40a7b749a304 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:40.307945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3c2b2-4644-4d45-adf3-40a7b749a304 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:40.309326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3c2b2-4644-4d45-adf3-40a7b749a304 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:40.365500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3f978-3d90-41a6-8133-8860f35f2ffd None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:40.379765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 376/744] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 21:25:40 2022] POST /identity/v3/services => generated 240 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:25:40.380524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3c2b2-4644-4d45-adf3-40a7b749a304 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:40.419306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170f30f-d462-4496-9307-d84852ba6b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:40.420052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170f30f-d462-4496-9307-d84852ba6b74 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:40.420608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170f30f-d462-4496-9307-d84852ba6b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:40.420885 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170f30f-d462-4496-9307-d84852ba6b74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:40.436743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170f30f-d462-4496-9307-d84852ba6b74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:40.438336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170f30f-d462-4496-9307-d84852ba6b74 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-8170f30f-d462-4496-9307-d84852ba6b74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:40.460731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:40.461711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:40.462589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:40.462589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:40.462589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:40.462589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:40.463258 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 369/745] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:40.467829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170f30f-d462-4496-9307-d84852ba6b74 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:40.520878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3c2b2-4644-4d45-adf3-40a7b749a304 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:40.526501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:40.567470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784049ee-6135-4043-ad94-02a1313e5119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:40.568921 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784049ee-6135-4043-ad94-02a1313e5119 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:40.569203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784049ee-6135-4043-ad94-02a1313e5119 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:40.569478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784049ee-6135-4043-ad94-02a1313e5119 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:40.570289 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784049ee-6135-4043-ad94-02a1313e5119 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:40.570594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784049ee-6135-4043-ad94-02a1313e5119 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:40.572662 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784049ee-6135-4043-ad94-02a1313e5119 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:40.592711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 377/746] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 25 21:25:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:40.593858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784049ee-6135-4043-ad94-02a1313e5119 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:40.610068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170f30f-d462-4496-9307-d84852ba6b74 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:40.633796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:40.653519 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daeca61-efa1-49e3-8be7-b55bee0f3a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:40.654092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeca61-efa1-49e3-8be7-b55bee0f3a3c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:40.654374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeca61-efa1-49e3-8be7-b55bee0f3a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:40.654720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeca61-efa1-49e3-8be7-b55bee0f3a3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:40.732930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784049ee-6135-4043-ad94-02a1313e5119 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:40.753145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daeca61-efa1-49e3-8be7-b55bee0f3a3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:40.754743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daeca61-efa1-49e3-8be7-b55bee0f3a3c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:40.779172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d57e2-1507-4db0-bef1-b4c5332f62e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:40.780227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d57e2-1507-4db0-bef1-b4c5332f62e3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:40.780981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d57e2-1507-4db0-bef1-b4c5332f62e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:40.781723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d57e2-1507-4db0-bef1-b4c5332f62e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:40.782606 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d57e2-1507-4db0-bef1-b4c5332f62e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:40.783222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d57e2-1507-4db0-bef1-b4c5332f62e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:40.785593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d57e2-1507-4db0-bef1-b4c5332f62e3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:40.800534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 378/747] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:40.801680 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:40.808024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d57e2-1507-4db0-bef1-b4c5332f62e3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:40.889255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 370/748] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:25:40.889255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daeca61-efa1-49e3-8be7-b55bee0f3a3c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:40.908057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:40.919640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d57e2-1507-4db0-bef1-b4c5332f62e3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:40.964229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d2910-ac54-4716-9303-40b6af9e51d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:40.965329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2910-ac54-4716-9303-40b6af9e51d8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:40.965796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2910-ac54-4716-9303-40b6af9e51d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:40.966537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2910-ac54-4716-9303-40b6af9e51d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:41.014238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daeca61-efa1-49e3-8be7-b55bee0f3a3c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:41.053704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541d29a-01c2-4f10-bb65-4cc227174be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:41.054376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541d29a-01c2-4f10-bb65-4cc227174be7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:41.054728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541d29a-01c2-4f10-bb65-4cc227174be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:41.055077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541d29a-01c2-4f10-bb65-4cc227174be7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:41.056010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d2910-ac54-4716-9303-40b6af9e51d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:41.057837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d2910-ac54-4716-9303-40b6af9e51d8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:41.063130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541d29a-01c2-4f10-bb65-4cc227174be7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:41.065407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541d29a-01c2-4f10-bb65-4cc227174be7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-c541d29a-01c2-4f10-bb65-4cc227174be7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:41.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:41.079357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:41.081011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:41.081011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:41.081011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:41.081011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:41.081011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:41.081011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:41.081011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:41.081011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:41.081011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:25:41.081011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:41.084933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 371/749] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 21:25:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:41.085871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541d29a-01c2-4f10-bb65-4cc227174be7 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:41.088797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:41.177273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:41.194852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 379/750] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:25:41.194852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d2910-ac54-4716-9303-40b6af9e51d8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:41.209515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541d29a-01c2-4f10-bb65-4cc227174be7 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:41.252854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3540fb-d3f9-42a1-a8d9-efc00879a8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:41.253940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3540fb-d3f9-42a1-a8d9-efc00879a8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:41.254343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3540fb-d3f9-42a1-a8d9-efc00879a8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:41.254719 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3540fb-d3f9-42a1-a8d9-efc00879a8e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:41.269215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3540fb-d3f9-42a1-a8d9-efc00879a8e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:41.270992 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3540fb-d3f9-42a1-a8d9-efc00879a8e8 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-eb3540fb-d3f9-42a1-a8d9-efc00879a8e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:41.289653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:41.290578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:41.291450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:41.291450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:41.291450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:41.291450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:41.295826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 372/751] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:41.296916 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3540fb-d3f9-42a1-a8d9-efc00879a8e8 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:41.311584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d2910-ac54-4716-9303-40b6af9e51d8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:41.349472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cdab4-dcfd-413f-a47d-3f4629480576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:41.350095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cdab4-dcfd-413f-a47d-3f4629480576 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:41.350422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cdab4-dcfd-413f-a47d-3f4629480576 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:41.350705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cdab4-dcfd-413f-a47d-3f4629480576 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:41.351510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cdab4-dcfd-413f-a47d-3f4629480576 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:41.351848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cdab4-dcfd-413f-a47d-3f4629480576 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:41.353457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cdab4-dcfd-413f-a47d-3f4629480576 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:41.372399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:41.374759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 380/752] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 21:25:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:41.375577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cdab4-dcfd-413f-a47d-3f4629480576 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:41.430247 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3540fb-d3f9-42a1-a8d9-efc00879a8e8 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:41.433721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:41.474620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dfb56-5c7c-4264-a88a-894378bbdd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:41.475309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dfb56-5c7c-4264-a88a-894378bbdd69 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:41.475585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dfb56-5c7c-4264-a88a-894378bbdd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:41.475876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dfb56-5c7c-4264-a88a-894378bbdd69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:41.491022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dfb56-5c7c-4264-a88a-894378bbdd69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:41.492644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dfb56-5c7c-4264-a88a-894378bbdd69 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:41.492994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cdab4-dcfd-413f-a47d-3f4629480576 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-f76dfb56-5c7c-4264-a88a-894378bbdd69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:41.512938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:41.513874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:41.514752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:41.514752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:41.514752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:41.514752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:41.520174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 373/753] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:41.521312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dfb56-5c7c-4264-a88a-894378bbdd69 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:41.532386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2034e-e8ec-4119-891a-81c7dda7ce6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:41.533003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2034e-e8ec-4119-891a-81c7dda7ce6e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:41.533801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2034e-e8ec-4119-891a-81c7dda7ce6e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:41.534300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2034e-e8ec-4119-891a-81c7dda7ce6e None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:41.535647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2034e-e8ec-4119-891a-81c7dda7ce6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:41.535985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2034e-e8ec-4119-891a-81c7dda7ce6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:41.537989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2034e-e8ec-4119-891a-81c7dda7ce6e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:41.555817 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 381/754] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:41.557036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2034e-e8ec-4119-891a-81c7dda7ce6e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:41.643146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dfb56-5c7c-4264-a88a-894378bbdd69 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:41.650218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:41.680249 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433c4a0-62d7-46d9-9c4e-9f57d361f677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:41.680447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2034e-e8ec-4119-891a-81c7dda7ce6e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:41.680898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433c4a0-62d7-46d9-9c4e-9f57d361f677 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:41.681182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433c4a0-62d7-46d9-9c4e-9f57d361f677 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:41.681456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433c4a0-62d7-46d9-9c4e-9f57d361f677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:41.691022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:41.695883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433c4a0-62d7-46d9-9c4e-9f57d361f677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:41.697297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433c4a0-62d7-46d9-9c4e-9f57d361f677 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-4433c4a0-62d7-46d9-9c4e-9f57d361f677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:41.713299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:41.714399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:41.715360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:41.715360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:41.715360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:41.715360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:41.715360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 374/755] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:41.715647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433c4a0-62d7-46d9-9c4e-9f57d361f677 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:41.724635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da300f-2ee3-46cc-a6cb-d5c4f735d8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:41.725477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da300f-2ee3-46cc-a6cb-d5c4f735d8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:41.725909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da300f-2ee3-46cc-a6cb-d5c4f735d8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:41.726407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da300f-2ee3-46cc-a6cb-d5c4f735d8d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:41.727280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da300f-2ee3-46cc-a6cb-d5c4f735d8d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:41.727770 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da300f-2ee3-46cc-a6cb-d5c4f735d8d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:41.729499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da300f-2ee3-46cc-a6cb-d5c4f735d8d8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:41.747118 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 382/756] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:41.748283 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233f4ae-0131-4220-85de-cd3b31f3deec None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:41.748576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233f4ae-0131-4220-85de-cd3b31f3deec None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:41.748851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233f4ae-0131-4220-85de-cd3b31f3deec None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:41.750481 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 383/757] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:41.751004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233f4ae-0131-4220-85de-cd3b31f3deec None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:41.823517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433c4a0-62d7-46d9-9c4e-9f57d361f677 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:41.857553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ea780-af5e-4003-9c8a-e97dce248711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:41.858257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ea780-af5e-4003-9c8a-e97dce248711 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:41.858480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ea780-af5e-4003-9c8a-e97dce248711 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:41.858758 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ea780-af5e-4003-9c8a-e97dce248711 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:41.859810 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233f4ae-0131-4220-85de-cd3b31f3deec None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:41.866001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ea780-af5e-4003-9c8a-e97dce248711 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:41.867423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ea780-af5e-4003-9c8a-e97dce248711 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-cb8ea780-af5e-4003-9c8a-e97dce248711 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:41.880328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:41.881232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:41.882146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:41.882146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:41.882146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:41.882146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:41.882146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:41.882146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:41.882146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:41.882146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:41.882146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 375/758] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:41.883237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ea780-af5e-4003-9c8a-e97dce248711 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:41.900802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76efa20-6033-423c-aa2c-e4f245d7ed17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:41.901350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76efa20-6033-423c-aa2c-e4f245d7ed17 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:41.901632 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76efa20-6033-423c-aa2c-e4f245d7ed17 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:41.901906 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76efa20-6033-423c-aa2c-e4f245d7ed17 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:41.902604 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76efa20-6033-423c-aa2c-e4f245d7ed17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:41.902931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76efa20-6033-423c-aa2c-e4f245d7ed17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:41.903851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:41.904336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76efa20-6033-423c-aa2c-e4f245d7ed17 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:41.917784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 384/759] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:41.919073 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f79067-8d85-4fb2-9cbf-a95917f3d612 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:41.919363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f79067-8d85-4fb2-9cbf-a95917f3d612 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:41.919640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f79067-8d85-4fb2-9cbf-a95917f3d612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:41.942117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-51f79067-8d85-4fb2-9cbf-a95917f3d612 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:41.943423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-51f79067-8d85-4fb2-9cbf-a95917f3d612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:41.967571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:41.995973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ea780-af5e-4003-9c8a-e97dce248711 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:42.020228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 385/760] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:42.020228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f79067-8d85-4fb2-9cbf-a95917f3d612 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:42.034594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770c773-d376-47a7-b484-9f1d35b57d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:42.035241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770c773-d376-47a7-b484-9f1d35b57d3b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:42.035529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770c773-d376-47a7-b484-9f1d35b57d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:42.035831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770c773-d376-47a7-b484-9f1d35b57d3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:42.043455 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770c773-d376-47a7-b484-9f1d35b57d3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:42.044924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770c773-d376-47a7-b484-9f1d35b57d3b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-e770c773-d376-47a7-b484-9f1d35b57d3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:42.056937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:42.057858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:42.058760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:42.058760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:42.058760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:42.058760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:42.058760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:42.058760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:42.058760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:42.058760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:42.058760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 376/761] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:42.059257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770c773-d376-47a7-b484-9f1d35b57d3b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:42.140201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f79067-8d85-4fb2-9cbf-a95917f3d612 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:42.145949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:42.167676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770c773-d376-47a7-b484-9f1d35b57d3b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:42.178038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3c56a-ee1f-427b-b8b1-ad8869cf6348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:42.178673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3c56a-ee1f-427b-b8b1-ad8869cf6348 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:42.178956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3c56a-ee1f-427b-b8b1-ad8869cf6348 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:42.179231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3c56a-ee1f-427b-b8b1-ad8869cf6348 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:42.180028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3c56a-ee1f-427b-b8b1-ad8869cf6348 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:42.180340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3c56a-ee1f-427b-b8b1-ad8869cf6348 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:42.181848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3c56a-ee1f-427b-b8b1-ad8869cf6348 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:42.195299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 386/762] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:42.196207 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3c56a-ee1f-427b-b8b1-ad8869cf6348 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:42.213085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459e2bf-d2d1-491a-ba52-a50d0a674b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:42.213825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459e2bf-d2d1-491a-ba52-a50d0a674b08 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:42.214111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459e2bf-d2d1-491a-ba52-a50d0a674b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:42.214391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459e2bf-d2d1-491a-ba52-a50d0a674b08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:42.219501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:42.221848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459e2bf-d2d1-491a-ba52-a50d0a674b08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:42.223329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459e2bf-d2d1-491a-ba52-a50d0a674b08 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-5459e2bf-d2d1-491a-ba52-a50d0a674b08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:42.234954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:42.235881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:42.237354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:42.237354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:42.237354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:42.237354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:42.237354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:42.237354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:42.237354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:42.237354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:42.237354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 377/763] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:42.237354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459e2bf-d2d1-491a-ba52-a50d0a674b08 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:42.310342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3c56a-ee1f-427b-b8b1-ad8869cf6348 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:42.346219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459e2bf-d2d1-491a-ba52-a50d0a674b08 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:42.353002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d33c7-cdaf-44fa-834f-ce73a8efb231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:42.353744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d33c7-cdaf-44fa-834f-ce73a8efb231 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:42.354037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d33c7-cdaf-44fa-834f-ce73a8efb231 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:42.354308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d33c7-cdaf-44fa-834f-ce73a8efb231 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:42.354943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d33c7-cdaf-44fa-834f-ce73a8efb231 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:42.356340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d33c7-cdaf-44fa-834f-ce73a8efb231 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-d42d33c7-cdaf-44fa-834f-ce73a8efb231 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:42.365377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:42.366345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:42.367182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 387/764] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Jul 25 21:25:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:42.368149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d33c7-cdaf-44fa-834f-ce73a8efb231 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:42.383808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e698ad6-48b9-4d85-a045-695f2b3eba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:42.384437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e698ad6-48b9-4d85-a045-695f2b3eba0d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:42.384722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e698ad6-48b9-4d85-a045-695f2b3eba0d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:42.384999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e698ad6-48b9-4d85-a045-695f2b3eba0d None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:42.385753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e698ad6-48b9-4d85-a045-695f2b3eba0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:42.386061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e698ad6-48b9-4d85-a045-695f2b3eba0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:42.387491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e698ad6-48b9-4d85-a045-695f2b3eba0d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:42.396576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:42.401923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 378/765] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:42.402601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e698ad6-48b9-4d85-a045-695f2b3eba0d None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:42.471800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:42.491717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d33c7-cdaf-44fa-834f-ce73a8efb231 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:42.513089 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e698ad6-48b9-4d85-a045-695f2b3eba0d None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:42.525760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa251d-cfd3-4fcd-a4df-2ca0009fd59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:42.526376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa251d-cfd3-4fcd-a4df-2ca0009fd59f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:42.526654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa251d-cfd3-4fcd-a4df-2ca0009fd59f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:42.526925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa251d-cfd3-4fcd-a4df-2ca0009fd59f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:42.527722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa251d-cfd3-4fcd-a4df-2ca0009fd59f None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=4c4863a61a484ed4b0dac01e908cd05a) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:42.528058 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa251d-cfd3-4fcd-a4df-2ca0009fd59f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:42.529484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa251d-cfd3-4fcd-a4df-2ca0009fd59f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:42.534810 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 388/766] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:42 2022] GET /identity/v3/role_assignments?user.id=4c4863a61a484ed4b0dac01e908cd05a&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:42.535580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa251d-cfd3-4fcd-a4df-2ca0009fd59f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:42.561971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cdb16-2c18-495f-adf5-23cce4c809dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:42.562624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cdb16-2c18-495f-adf5-23cce4c809dd None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:42.562943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cdb16-2c18-495f-adf5-23cce4c809dd None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:42.563258 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cdb16-2c18-495f-adf5-23cce4c809dd None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:42.563986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cdb16-2c18-495f-adf5-23cce4c809dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:42.564299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cdb16-2c18-495f-adf5-23cce4c809dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:42.566400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cdb16-2c18-495f-adf5-23cce4c809dd None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:42.579169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 379/767] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:42.579892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cdb16-2c18-495f-adf5-23cce4c809dd None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:42.650067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:42.664826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa251d-cfd3-4fcd-a4df-2ca0009fd59f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:42.707110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cdb16-2c18-495f-adf5-23cce4c809dd None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:42.708046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94296fdd-df1e-4888-9aee-cad85e107c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:42.708676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296fdd-df1e-4888-9aee-cad85e107c2e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:42.708956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296fdd-df1e-4888-9aee-cad85e107c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:42.709241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296fdd-df1e-4888-9aee-cad85e107c2e None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:42.709912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94296fdd-df1e-4888-9aee-cad85e107c2e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:42.710225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94296fdd-df1e-4888-9aee-cad85e107c2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:42.711613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94296fdd-df1e-4888-9aee-cad85e107c2e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:42.716590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 389/768] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 25 21:25:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:42.717782 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36a4d2-fc58-4e2d-b115-00be20797597 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:42.718067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36a4d2-fc58-4e2d-b115-00be20797597 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:42.718342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36a4d2-fc58-4e2d-b115-00be20797597 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:42.723875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 390/769] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:42.723875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36a4d2-fc58-4e2d-b115-00be20797597 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:42.735022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:42.751125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639834ef-ca88-4bd5-a488-ab150f14d712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:42.751778 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639834ef-ca88-4bd5-a488-ab150f14d712 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:42.752618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639834ef-ca88-4bd5-a488-ab150f14d712 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:42.753034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639834ef-ca88-4bd5-a488-ab150f14d712 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:42.753838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639834ef-ca88-4bd5-a488-ab150f14d712 None admin] RBAC: Adding query filter params (role.id=41a3de4f5213430bb14205f0f3aabadc, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=586e22d3792b4759a38ab4c3bc12cf3b) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:42.754150 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639834ef-ca88-4bd5-a488-ab150f14d712 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:42.755626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639834ef-ca88-4bd5-a488-ab150f14d712 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:42.762320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 380/770] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:42 2022] GET /identity/v3/role_assignments?user.id=586e22d3792b4759a38ab4c3bc12cf3b&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=41a3de4f5213430bb14205f0f3aabadc => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:42.763346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639834ef-ca88-4bd5-a488-ab150f14d712 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:42.862916 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36a4d2-fc58-4e2d-b115-00be20797597 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:42.901955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cf50f-0664-46da-b1a1-438ef6addac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:42.902790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cf50f-0664-46da-b1a1-438ef6addac9 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:42.903175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cf50f-0664-46da-b1a1-438ef6addac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:42.903554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cf50f-0664-46da-b1a1-438ef6addac9 None admin] PATH_INFO: `/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/7d3d6613476c445b82302df5025f3ce6/roles/11da9ce3f79148679dbde9eb2c568e55` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:42.904352 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639834ef-ca88-4bd5-a488-ab150f14d712 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:42.906200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cf50f-0664-46da-b1a1-438ef6addac9 None admin] RBAC: Authorizing `identity:create_grant(project_id=48d9c81feed744bb9e322910711a0d3b, user_id=7d3d6613476c445b82302df5025f3ce6, role_id=11da9ce3f79148679dbde9eb2c568e55)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:42.908020 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cf50f-0664-46da-b1a1-438ef6addac9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:42.931001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:42.942931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd848c1-ddae-4c33-becd-dcd4fff555b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:42.943560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd848c1-ddae-4c33-becd-dcd4fff555b7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:42.943988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd848c1-ddae-4c33-becd-dcd4fff555b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:42.944266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd848c1-ddae-4c33-becd-dcd4fff555b7 None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:42.944956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd848c1-ddae-4c33-becd-dcd4fff555b7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:42.951772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd848c1-ddae-4c33-becd-dcd4fff555b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:42.951772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd848c1-ddae-4c33-becd-dcd4fff555b7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:42.952704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 381/771] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 25 21:25:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:42.953893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740ec77-40e8-4242-a4fc-23958cc35b0c None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:42.954174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740ec77-40e8-4242-a4fc-23958cc35b0c None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:42.954450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740ec77-40e8-4242-a4fc-23958cc35b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:42.973685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-6740ec77-40e8-4242-a4fc-23958cc35b0c None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:42.974943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-6740ec77-40e8-4242-a4fc-23958cc35b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:43.000827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 391/772] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:25:42 2022] PUT /identity/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/7d3d6613476c445b82302df5025f3ce6/roles/11da9ce3f79148679dbde9eb2c568e55 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:25:43.002638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cf50f-0664-46da-b1a1-438ef6addac9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:43.070187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 382/773] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:43.092814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740ec77-40e8-4242-a4fc-23958cc35b0c None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:43.101587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:43.147408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cf50f-0664-46da-b1a1-438ef6addac9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:43.209611 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59293d-9af8-4e09-9b2b-aedbfa378b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:43.210577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59293d-9af8-4e09-9b2b-aedbfa378b83 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:43.211016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59293d-9af8-4e09-9b2b-aedbfa378b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:43.211443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59293d-9af8-4e09-9b2b-aedbfa378b83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:43.212505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59293d-9af8-4e09-9b2b-aedbfa378b83 None admin] RBAC: Adding query filter params (interface=public, service_id=85ff4a501edf45afae8a0bb0cdb76e1a, region_id=RegionOne) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:43.212980 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59293d-9af8-4e09-9b2b-aedbfa378b83 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:43.214554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59293d-9af8-4e09-9b2b-aedbfa378b83 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:43.219241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740ec77-40e8-4242-a4fc-23958cc35b0c None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:43.224435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 392/774] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 21:25:43 2022] GET /identity/v3/endpoints?service_id=85ff4a501edf45afae8a0bb0cdb76e1a&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:43.241482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59293d-9af8-4e09-9b2b-aedbfa378b83 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:43.244782 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:43.271246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b67468-404b-4480-9e78-dbfbd0fd441a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:43.271989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b67468-404b-4480-9e78-dbfbd0fd441a None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:43.272321 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b67468-404b-4480-9e78-dbfbd0fd441a None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:43.272594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b67468-404b-4480-9e78-dbfbd0fd441a None admin] PATH_INFO: `/v3/services/network` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:43.273327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b67468-404b-4480-9e78-dbfbd0fd441a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:43.274979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b67468-404b-4480-9e78-dbfbd0fd441a None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-f9b67468-404b-4480-9e78-dbfbd0fd441a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:43.288831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:43.289865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:43.290687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 383/775] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:43 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:43.296330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b67468-404b-4480-9e78-dbfbd0fd441a None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:43.366376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59293d-9af8-4e09-9b2b-aedbfa378b83 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:43.404007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b67468-404b-4480-9e78-dbfbd0fd441a None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:43.414681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab7432-c856-484e-b3ba-24d03eb0d1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:43.415389 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab7432-c856-484e-b3ba-24d03eb0d1dc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:43.415679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab7432-c856-484e-b3ba-24d03eb0d1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:43.415976 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab7432-c856-484e-b3ba-24d03eb0d1dc None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:43.416755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab7432-c856-484e-b3ba-24d03eb0d1dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:43.418140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab7432-c856-484e-b3ba-24d03eb0d1dc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:43.419431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:43.431030 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 393/776] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 21:25:43 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:43.443215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe88f68-1702-4e84-b470-8a0ee6da6174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:43.443889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe88f68-1702-4e84-b470-8a0ee6da6174 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:43.444170 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe88f68-1702-4e84-b470-8a0ee6da6174 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:43.444445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe88f68-1702-4e84-b470-8a0ee6da6174 None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:43.445202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe88f68-1702-4e84-b470-8a0ee6da6174 None admin] RBAC: Adding query filter params (name=network) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:43.445507 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe88f68-1702-4e84-b470-8a0ee6da6174 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:43.447006 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe88f68-1702-4e84-b470-8a0ee6da6174 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:43.453521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 384/777] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 21:25:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:43.459258 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab7432-c856-484e-b3ba-24d03eb0d1dc None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:43.610187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab7432-c856-484e-b3ba-24d03eb0d1dc None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:43.659555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8df965-19dd-4a18-917f-46e04b1f2408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:43.660261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8df965-19dd-4a18-917f-46e04b1f2408 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:43.660547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8df965-19dd-4a18-917f-46e04b1f2408 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:43.660821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8df965-19dd-4a18-917f-46e04b1f2408 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:43.661759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8df965-19dd-4a18-917f-46e04b1f2408 None admin] RBAC: Adding query filter params (type=network) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:43.662064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8df965-19dd-4a18-917f-46e04b1f2408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:43.663433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8df965-19dd-4a18-917f-46e04b1f2408 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:43.669567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 394/778] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 21:25:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:43.681044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe88f68-1702-4e84-b470-8a0ee6da6174 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:43.742628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:43.811787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe88f68-1702-4e84-b470-8a0ee6da6174 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:43.855389 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14f53a-6b72-4122-84e1-6643a82cdf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:43.856048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14f53a-6b72-4122-84e1-6643a82cdf0c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:43.856378 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14f53a-6b72-4122-84e1-6643a82cdf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:43.856660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14f53a-6b72-4122-84e1-6643a82cdf0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:43.857421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14f53a-6b72-4122-84e1-6643a82cdf0c None admin] RBAC: Adding query filter params (interface=public, service_id=a9f4470678c34c238eb6eceaf02878d4, region_id=RegionOne) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:43.857726 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14f53a-6b72-4122-84e1-6643a82cdf0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:43.859086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14f53a-6b72-4122-84e1-6643a82cdf0c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:43.870010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 385/779] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 21:25:43 2022] GET /identity/v3/endpoints?service_id=a9f4470678c34c238eb6eceaf02878d4&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:43.875504 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8df965-19dd-4a18-917f-46e04b1f2408 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:43.967889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:44.022417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8df965-19dd-4a18-917f-46e04b1f2408 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:44.074703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce77bb1-d2d7-45a8-ab7e-a37e23decb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:44.075331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77bb1-d2d7-45a8-ab7e-a37e23decb93 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:44.075614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77bb1-d2d7-45a8-ab7e-a37e23decb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:44.075911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77bb1-d2d7-45a8-ab7e-a37e23decb93 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:44.076573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce77bb1-d2d7-45a8-ab7e-a37e23decb93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:44.078012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce77bb1-d2d7-45a8-ab7e-a37e23decb93 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:44.088429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 395/780] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 21:25:43 2022] GET /identity/v3/services => generated 772 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:45.075451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ede55-9ca7-40d5-8285-6c3cfa88b680 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:45.076501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ede55-9ca7-40d5-8285-6c3cfa88b680 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:45.077012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ede55-9ca7-40d5-8285-6c3cfa88b680 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:45.078830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 386/781] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:45.084998 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971406a7-51a2-4631-a4c0-34e6f092e761 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:45.085848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971406a7-51a2-4631-a4c0-34e6f092e761 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:45.086324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971406a7-51a2-4631-a4c0-34e6f092e761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:45.116876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-971406a7-51a2-4631-a4c0-34e6f092e761 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:45.118442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-971406a7-51a2-4631-a4c0-34e6f092e761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:45.205814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 396/782] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:45.239962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ede55-9ca7-40d5-8285-6c3cfa88b680 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:45.293631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599edfd-0c6b-4402-b1f4-61353fb8277f None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:45.294456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599edfd-0c6b-4402-b1f4-61353fb8277f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:45.296067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599edfd-0c6b-4402-b1f4-61353fb8277f None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:45.297710 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 397/783] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:45.304820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2517d0-2f91-4ee9-af08-fd3067602a94 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:45.305125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2517d0-2f91-4ee9-af08-fd3067602a94 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:45.305347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2517d0-2f91-4ee9-af08-fd3067602a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:45.345439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-3c2517d0-2f91-4ee9-af08-fd3067602a94 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:45.348237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3c2517d0-2f91-4ee9-af08-fd3067602a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:45.403891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ede55-9ca7-40d5-8285-6c3cfa88b680 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:45.418257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:45.436143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:45.445590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452bc57-8e76-4ec9-9382-1d2bc034876f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:45.446468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452bc57-8e76-4ec9-9382-1d2bc034876f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:45.446759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452bc57-8e76-4ec9-9382-1d2bc034876f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:45.447034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452bc57-8e76-4ec9-9382-1d2bc034876f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:45.465702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 398/784] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:25:45.468994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452bc57-8e76-4ec9-9382-1d2bc034876f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-3452bc57-8e76-4ec9-9382-1d2bc034876f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:45.474557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:45.481472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:45.482316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:45.482316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:45.482316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:45.482316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:45.482316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:45.482316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:45.482316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:45.482316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:45.482316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:45.482316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:45.482316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:45.482316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:45.482316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 387/785] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:25:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:45.483012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2517d0-2f91-4ee9-af08-fd3067602a94 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:45.505161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452bc57-8e76-4ec9-9382-1d2bc034876f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:45.593282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2517d0-2f91-4ee9-af08-fd3067602a94 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:45.631591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de698f-d5a0-455b-b1eb-8e5b47c97b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:45.632180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de698f-d5a0-455b-b1eb-8e5b47c97b6b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:45.632465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de698f-d5a0-455b-b1eb-8e5b47c97b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:45.632742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de698f-d5a0-455b-b1eb-8e5b47c97b6b None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:45.633574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de698f-d5a0-455b-b1eb-8e5b47c97b6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:45.633982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de698f-d5a0-455b-b1eb-8e5b47c97b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:45.635469 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de698f-d5a0-455b-b1eb-8e5b47c97b6b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:45.645968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 399/786] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:45.647469 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2856d25-a466-43fb-b8d8-8f62d96c84bb None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:45.647775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2856d25-a466-43fb-b8d8-8f62d96c84bb None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:45.648056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2856d25-a466-43fb-b8d8-8f62d96c84bb None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:45.649743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 400/787] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:45.651056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2856d25-a466-43fb-b8d8-8f62d96c84bb None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:45.664620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452bc57-8e76-4ec9-9382-1d2bc034876f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:45.702749 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712f34f-e7e8-49d9-9334-5875eb34cc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:45.703560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712f34f-e7e8-49d9-9334-5875eb34cc92 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:45.704029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712f34f-e7e8-49d9-9334-5875eb34cc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:45.704456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712f34f-e7e8-49d9-9334-5875eb34cc92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:45.715767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712f34f-e7e8-49d9-9334-5875eb34cc92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:45.717549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-1712f34f-e7e8-49d9-9334-5875eb34cc92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:45.721328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:45.722274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:45.723088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:45.723088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:45.723088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:45.723088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:45.723088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:45.723088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:45.723088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:45.723088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:45.723088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:45.723088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:45.723088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:45.723088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:45.725564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 388/788] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:45.726923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab955bca-7563-4170-ada8-27f53e1bd712 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:45.732706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab955bca-7563-4170-ada8-27f53e1bd712 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:45.732706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab955bca-7563-4170-ada8-27f53e1bd712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:45.747039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-ab955bca-7563-4170-ada8-27f53e1bd712 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:45.748535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-ab955bca-7563-4170-ada8-27f53e1bd712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:45.783410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:45.784381 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2856d25-a466-43fb-b8d8-8f62d96c84bb None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:45.822878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87257f6f-fd36-431a-88a4-3bbbf531d34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:45.824011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87257f6f-fd36-431a-88a4-3bbbf531d34e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:45.824523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87257f6f-fd36-431a-88a4-3bbbf531d34e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:45.824998 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87257f6f-fd36-431a-88a4-3bbbf531d34e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:45.838237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 389/789] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:45.838992 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87257f6f-fd36-431a-88a4-3bbbf531d34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:45.839176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab955bca-7563-4170-ada8-27f53e1bd712 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:45.840970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87257f6f-fd36-431a-88a4-3bbbf531d34e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-87257f6f-fd36-431a-88a4-3bbbf531d34e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:45.858432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:45.859351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:45.860278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:45.860278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:45.860278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:45.860278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:45.863326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 401/790] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:45.871866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87257f6f-fd36-431a-88a4-3bbbf531d34e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:45.942385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab955bca-7563-4170-ada8-27f53e1bd712 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:45.977575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3a60c-700a-40b2-9403-9d3edd003c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:45.978633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3a60c-700a-40b2-9403-9d3edd003c95 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:45.978920 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3a60c-700a-40b2-9403-9d3edd003c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:45.979199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3a60c-700a-40b2-9403-9d3edd003c95 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:45.979958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3a60c-700a-40b2-9403-9d3edd003c95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:45.980268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3a60c-700a-40b2-9403-9d3edd003c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:45.981949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3a60c-700a-40b2-9403-9d3edd003c95 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:45.990765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:45.993369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 390/791] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:45.994962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3a60c-700a-40b2-9403-9d3edd003c95 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:46.000737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87257f6f-fd36-431a-88a4-3bbbf531d34e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:46.025548 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:46.042852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5c3f1-8e04-4f1a-8ee7-5e4f20f91ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:46.044928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5c3f1-8e04-4f1a-8ee7-5e4f20f91ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.044928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5c3f1-8e04-4f1a-8ee7-5e4f20f91ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.044928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5c3f1-8e04-4f1a-8ee7-5e4f20f91ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.044928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5c3f1-8e04-4f1a-8ee7-5e4f20f91ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:46.045233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5c3f1-8e04-4f1a-8ee7-5e4f20f91ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:46.046435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5c3f1-8e04-4f1a-8ee7-5e4f20f91ae3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:46.058467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 402/792] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:46.059289 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5c3f1-8e04-4f1a-8ee7-5e4f20f91ae3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:46.110747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3a60c-700a-40b2-9403-9d3edd003c95 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:46.146896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed14ef-6073-4bf6-b8fe-efb7744d56f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:46.147646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed14ef-6073-4bf6-b8fe-efb7744d56f4 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.147953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed14ef-6073-4bf6-b8fe-efb7744d56f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.148229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed14ef-6073-4bf6-b8fe-efb7744d56f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.160363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed14ef-6073-4bf6-b8fe-efb7744d56f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-c8ed14ef-6073-4bf6-b8fe-efb7744d56f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:46.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:46.166687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:46.167538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:46.167538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:46.167538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:46.167538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:46.167538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:46.167538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:46.167538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:46.167538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:46.167538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:46.167538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:46.167538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:46.167538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:46.168718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5c3f1-8e04-4f1a-8ee7-5e4f20f91ae3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:46.169120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 391/793] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:25:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:46.169120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef1fcc-36ac-4bd6-bedd-facad47cd32b None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.169423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef1fcc-36ac-4bd6-bedd-facad47cd32b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.169708 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef1fcc-36ac-4bd6-bedd-facad47cd32b None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.171058 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 392/794] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:46.171586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef1fcc-36ac-4bd6-bedd-facad47cd32b None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:46.207793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226f73a-8994-4e00-b69b-af0b18a418a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:46.208408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226f73a-8994-4e00-b69b-af0b18a418a1 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.208695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226f73a-8994-4e00-b69b-af0b18a418a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.208969 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226f73a-8994-4e00-b69b-af0b18a418a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.223871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226f73a-8994-4e00-b69b-af0b18a418a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:46.225342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226f73a-8994-4e00-b69b-af0b18a418a1 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b226f73a-8994-4e00-b69b-af0b18a418a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:46.239873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:46.240769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:46.241655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:46.241655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:46.241655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:46.241655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:46.241655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 403/795] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:46.241934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226f73a-8994-4e00-b69b-af0b18a418a1 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:46.257108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:46.269741 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:46.292496 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef1fcc-36ac-4bd6-bedd-facad47cd32b None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:46.331316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199b546-6078-4ebc-84e9-5f7946e3c5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:46.332003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199b546-6078-4ebc-84e9-5f7946e3c5df None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.332291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199b546-6078-4ebc-84e9-5f7946e3c5df None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.332569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199b546-6078-4ebc-84e9-5f7946e3c5df None admin] PATH_INFO: `/v3/users/swift` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.340000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199b546-6078-4ebc-84e9-5f7946e3c5df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:46.341437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199b546-6078-4ebc-84e9-5f7946e3c5df None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:46.350691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226f73a-8994-4e00-b69b-af0b18a418a1 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-d199b546-6078-4ebc-84e9-5f7946e3c5df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:46.353884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:46.354771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:46.360370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:46.360370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:46.360370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:46.360370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:46.360370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:46.360370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:46.360370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:46.360370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:46.360370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 21:25:46.360370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:46.360370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 393/796] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:25:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:46.360370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a10302-72a9-4148-8bf3-6db5de10256a None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.360370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a10302-72a9-4148-8bf3-6db5de10256a None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.361057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a10302-72a9-4148-8bf3-6db5de10256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.375701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-84a10302-72a9-4148-8bf3-6db5de10256a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:46.377479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-84a10302-72a9-4148-8bf3-6db5de10256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:46.392147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62190-06a3-4f48-8b5c-7a0c1c1e25ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:46.393233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62190-06a3-4f48-8b5c-7a0c1c1e25ed None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.393346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62190-06a3-4f48-8b5c-7a0c1c1e25ed None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.393570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62190-06a3-4f48-8b5c-7a0c1c1e25ed None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.394413 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce62190-06a3-4f48-8b5c-7a0c1c1e25ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:46.394718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce62190-06a3-4f48-8b5c-7a0c1c1e25ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:46.396276 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce62190-06a3-4f48-8b5c-7a0c1c1e25ed None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:46.410842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 404/797] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:46.410842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62190-06a3-4f48-8b5c-7a0c1c1e25ed None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:46.461856 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 394/798] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:46.461856 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a10302-72a9-4148-8bf3-6db5de10256a None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:46.500215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:46.526830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62190-06a3-4f48-8b5c-7a0c1c1e25ed None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:46.542255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:46.571665 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47e20c-4c4f-4947-bda7-a6b3a845fdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:46.572320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47e20c-4c4f-4947-bda7-a6b3a845fdfe None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.572603 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47e20c-4c4f-4947-bda7-a6b3a845fdfe None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.572719 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a10302-72a9-4148-8bf3-6db5de10256a None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:46.572875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47e20c-4c4f-4947-bda7-a6b3a845fdfe None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.573574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47e20c-4c4f-4947-bda7-a6b3a845fdfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:46.573880 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47e20c-4c4f-4947-bda7-a6b3a845fdfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:46.575511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47e20c-4c4f-4947-bda7-a6b3a845fdfe None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:46.589113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 405/799] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:46.589936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47e20c-4c4f-4947-bda7-a6b3a845fdfe None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:46.613160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec9a8b-df74-420f-8bee-e1382ce247b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:46.613781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec9a8b-df74-420f-8bee-e1382ce247b3 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.614062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec9a8b-df74-420f-8bee-e1382ce247b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.614340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec9a8b-df74-420f-8bee-e1382ce247b3 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.615124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec9a8b-df74-420f-8bee-e1382ce247b3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:46.615435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec9a8b-df74-420f-8bee-e1382ce247b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:46.616881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec9a8b-df74-420f-8bee-e1382ce247b3 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:46.634343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 395/800] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 25 21:25:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:46.635148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec9a8b-df74-420f-8bee-e1382ce247b3 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:46.695715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47e20c-4c4f-4947-bda7-a6b3a845fdfe None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:46.731024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c58c72-b8c4-43d5-b74c-3970e00be891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:46.731591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c58c72-b8c4-43d5-b74c-3970e00be891 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.731908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c58c72-b8c4-43d5-b74c-3970e00be891 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.732184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c58c72-b8c4-43d5-b74c-3970e00be891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.733868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec9a8b-df74-420f-8bee-e1382ce247b3 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:46.734141 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:46.742750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c58c72-b8c4-43d5-b74c-3970e00be891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:46.744241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c58c72-b8c4-43d5-b74c-3970e00be891 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-c0c58c72-b8c4-43d5-b74c-3970e00be891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:46.759465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:46.760526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:46.766512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:46.766512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:46.766512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:46.766512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:46.766512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 406/801] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:46.766512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa113364-bc0b-472b-9802-3d1c00b91f58 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.766512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa113364-bc0b-472b-9802-3d1c00b91f58 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.766512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa113364-bc0b-472b-9802-3d1c00b91f58 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.766512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 407/802] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:46.767027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa113364-bc0b-472b-9802-3d1c00b91f58 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:46.768671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:46.773395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277700a-b88c-4359-bc8a-a7029d5b43b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:46.774048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277700a-b88c-4359-bc8a-a7029d5b43b9 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.774329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277700a-b88c-4359-bc8a-a7029d5b43b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.774604 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277700a-b88c-4359-bc8a-a7029d5b43b9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.775240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277700a-b88c-4359-bc8a-a7029d5b43b9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:46.776639 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277700a-b88c-4359-bc8a-a7029d5b43b9 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-e277700a-b88c-4359-bc8a-a7029d5b43b9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:46.785803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:46.787130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:46.793091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 396/803] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Jul 25 21:25:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:46.793933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277700a-b88c-4359-bc8a-a7029d5b43b9 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:46.868997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa113364-bc0b-472b-9802-3d1c00b91f58 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:46.888762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277700a-b88c-4359-bc8a-a7029d5b43b9 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:46.903084 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93651c7c-445c-4fa3-8c25-2355f4f5da0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:46.903726 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93651c7c-445c-4fa3-8c25-2355f4f5da0b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.904036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93651c7c-445c-4fa3-8c25-2355f4f5da0b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.904313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93651c7c-445c-4fa3-8c25-2355f4f5da0b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.915846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93651c7c-445c-4fa3-8c25-2355f4f5da0b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:46.917332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93651c7c-445c-4fa3-8c25-2355f4f5da0b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:46.926690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586f534-8082-445e-8646-c1e644ce0b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:46.927329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586f534-8082-445e-8646-c1e644ce0b0d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.927610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586f534-8082-445e-8646-c1e644ce0b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.927928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586f534-8082-445e-8646-c1e644ce0b0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-93651c7c-445c-4fa3-8c25-2355f4f5da0b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:46.928972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:46.929967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:46.930909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:46.930909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:46.930909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:46.930909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:46.930909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:46.930909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:46.930909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:46.930909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:46.930909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 21:25:46.930909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:46.930909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 408/804] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 21:25:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:46.931497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93651c7c-445c-4fa3-8c25-2355f4f5da0b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:46.943659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586f534-8082-445e-8646-c1e644ce0b0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:46.945126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586f534-8082-445e-8646-c1e644ce0b0d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-f586f534-8082-445e-8646-c1e644ce0b0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:46.959544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:46.960653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:46.961832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:46.961832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:46.961832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:46.961832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:46.961832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 397/805] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:46.962172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb9919-fdf8-48a6-a60c-e2e36cc34c25 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:46.962410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb9919-fdf8-48a6-a60c-e2e36cc34c25 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:46.962688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb9919-fdf8-48a6-a60c-e2e36cc34c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:46.980071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-30bb9919-fdf8-48a6-a60c-e2e36cc34c25 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:46.980860 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:46.981307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-30bb9919-fdf8-48a6-a60c-e2e36cc34c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:47.021707 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:47.034140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93651c7c-445c-4fa3-8c25-2355f4f5da0b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:47.047658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 398/806] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:47.048571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb9919-fdf8-48a6-a60c-e2e36cc34c25 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:47.073544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4804e3-73b7-423c-95a6-7f6c3d1da715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:47.074162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4804e3-73b7-423c-95a6-7f6c3d1da715 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:47.074445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4804e3-73b7-423c-95a6-7f6c3d1da715 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:47.074720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4804e3-73b7-423c-95a6-7f6c3d1da715 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:47.075413 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4804e3-73b7-423c-95a6-7f6c3d1da715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:47.075718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4804e3-73b7-423c-95a6-7f6c3d1da715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:47.077106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4804e3-73b7-423c-95a6-7f6c3d1da715 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:47.090171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 409/807] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:47.090965 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4804e3-73b7-423c-95a6-7f6c3d1da715 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:47.151926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb9919-fdf8-48a6-a60c-e2e36cc34c25 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:47.186090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a556b-7f9c-474d-bf09-884384aa8279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:47.186712 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a556b-7f9c-474d-bf09-884384aa8279 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:47.186990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a556b-7f9c-474d-bf09-884384aa8279 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:47.187265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a556b-7f9c-474d-bf09-884384aa8279 None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:47.188038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a556b-7f9c-474d-bf09-884384aa8279 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:47.188344 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a556b-7f9c-474d-bf09-884384aa8279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:47.189740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a556b-7f9c-474d-bf09-884384aa8279 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:47.190199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4804e3-73b7-423c-95a6-7f6c3d1da715 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:47.194229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 399/808] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 25 21:25:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:47.194999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a556b-7f9c-474d-bf09-884384aa8279 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:47.197649 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:47.224988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055f179-5a6e-41de-9f1f-f3a63f3219d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:47.225601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f179-5a6e-41de-9f1f-f3a63f3219d0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:47.225880 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f179-5a6e-41de-9f1f-f3a63f3219d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:47.226147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f179-5a6e-41de-9f1f-f3a63f3219d0 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:47.226937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055f179-5a6e-41de-9f1f-f3a63f3219d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:47.227241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055f179-5a6e-41de-9f1f-f3a63f3219d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:47.228680 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055f179-5a6e-41de-9f1f-f3a63f3219d0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:47.236307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:47.246466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 410/809] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 25 21:25:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:47.247254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055f179-5a6e-41de-9f1f-f3a63f3219d0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:47.298093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a556b-7f9c-474d-bf09-884384aa8279 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:47.332368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e54bf-2a19-48a1-8745-3d1720c9ce67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:47.332987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e54bf-2a19-48a1-8745-3d1720c9ce67 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:47.333265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e54bf-2a19-48a1-8745-3d1720c9ce67 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:47.333538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e54bf-2a19-48a1-8745-3d1720c9ce67 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:47.334227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e54bf-2a19-48a1-8745-3d1720c9ce67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:47.334530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e54bf-2a19-48a1-8745-3d1720c9ce67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:47.335909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e54bf-2a19-48a1-8745-3d1720c9ce67 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:47.347074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055f179-5a6e-41de-9f1f-f3a63f3219d0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:47.347231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 400/810] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:47.348053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e54bf-2a19-48a1-8745-3d1720c9ce67 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:47.381208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa76521-2d26-44b4-b213-eb79ce072f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:47.381755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa76521-2d26-44b4-b213-eb79ce072f98 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:47.382039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa76521-2d26-44b4-b213-eb79ce072f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:47.382322 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa76521-2d26-44b4-b213-eb79ce072f98 None admin] PATH_INFO: `/v3/services/network` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:47.382952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa76521-2d26-44b4-b213-eb79ce072f98 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:47.384368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa76521-2d26-44b4-b213-eb79ce072f98 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-1fa76521-2d26-44b4-b213-eb79ce072f98 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:47.393926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:47.394914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:47.395780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 411/811] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:47 2022] GET /identity/v3/services/network => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:47.396584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa76521-2d26-44b4-b213-eb79ce072f98 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:47.423514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:47.451696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:47.458326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e54bf-2a19-48a1-8745-3d1720c9ce67 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:47.491567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e67539-daf0-4401-82b0-8f638cf1f574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:47.492161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e67539-daf0-4401-82b0-8f638cf1f574 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:47.492791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e67539-daf0-4401-82b0-8f638cf1f574 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:47.493129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e67539-daf0-4401-82b0-8f638cf1f574 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:47.495328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa76521-2d26-44b4-b213-eb79ce072f98 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:47.501420 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e67539-daf0-4401-82b0-8f638cf1f574 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:47.504013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e67539-daf0-4401-82b0-8f638cf1f574 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-69e67539-daf0-4401-82b0-8f638cf1f574 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:47.516341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:47.517391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:47.519790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:47.519790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:47.519790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:47.519790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:47.519790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:47.519790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:47.519790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:47.519790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:47.519790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:25:47.519790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:47.519790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 401/812] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 21:25:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:47.519790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e67539-daf0-4401-82b0-8f638cf1f574 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:47.530743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6884fb-1165-4d2f-8163-ceaca071280d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:47.531368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6884fb-1165-4d2f-8163-ceaca071280d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:47.531650 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6884fb-1165-4d2f-8163-ceaca071280d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:47.531958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6884fb-1165-4d2f-8163-ceaca071280d None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:47.532643 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6884fb-1165-4d2f-8163-ceaca071280d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:47.532956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6884fb-1165-4d2f-8163-ceaca071280d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:47.534899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6884fb-1165-4d2f-8163-ceaca071280d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:47.539921 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 412/813] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 25 21:25:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:47.540687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6884fb-1165-4d2f-8163-ceaca071280d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:47.624638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e67539-daf0-4401-82b0-8f638cf1f574 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:47.633616 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:47.642012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6884fb-1165-4d2f-8163-ceaca071280d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:47.660073 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d447f9a-db7e-4fbd-a4fa-4bfe21b503eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:47.660717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d447f9a-db7e-4fbd-a4fa-4bfe21b503eb None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:47.661004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d447f9a-db7e-4fbd-a4fa-4bfe21b503eb None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:47.661280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d447f9a-db7e-4fbd-a4fa-4bfe21b503eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:47.672757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d447f9a-db7e-4fbd-a4fa-4bfe21b503eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:47.674938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d447f9a-db7e-4fbd-a4fa-4bfe21b503eb None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:47.677317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a25b6-1b83-42c0-b353-a3e221d2483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:47.677963 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a25b6-1b83-42c0-b353-a3e221d2483a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:47.678245 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a25b6-1b83-42c0-b353-a3e221d2483a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:47.678519 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a25b6-1b83-42c0-b353-a3e221d2483a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:47.685284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a25b6-1b83-42c0-b353-a3e221d2483a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:47.686709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a25b6-1b83-42c0-b353-a3e221d2483a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-6d447f9a-db7e-4fbd-a4fa-4bfe21b503eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:47.689869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:47.690720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:47.692062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:47.692062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:47.692062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:47.692062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:47.692062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 402/814] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:47.692062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d447f9a-db7e-4fbd-a4fa-4bfe21b503eb None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-8f2a25b6-1b83-42c0-b353-a3e221d2483a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:47.699120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:47.700238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:47.701282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:47.701282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:47.701282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:47.701282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:47.701282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:47.701282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:47.701282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:47.701282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:47.701282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 413/815] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:47.701282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a25b6-1b83-42c0-b353-a3e221d2483a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:47.706797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:47.795301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d447f9a-db7e-4fbd-a4fa-4bfe21b503eb None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:47.802944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a25b6-1b83-42c0-b353-a3e221d2483a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:47.828393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9469b80-41e9-4930-9eab-fb065cf40a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:47.829126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469b80-41e9-4930-9eab-fb065cf40a17 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:47.829415 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469b80-41e9-4930-9eab-fb065cf40a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:47.829691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469b80-41e9-4930-9eab-fb065cf40a17 None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:47.831015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9469b80-41e9-4930-9eab-fb065cf40a17 None admin] RBAC: Adding query filter params (name=network) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:47.831321 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9469b80-41e9-4930-9eab-fb065cf40a17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:47.832715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9469b80-41e9-4930-9eab-fb065cf40a17 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:47.836243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e306979-6cae-493b-972b-92742ce73e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:47.836858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e306979-6cae-493b-972b-92742ce73e6b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:47.837139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e306979-6cae-493b-972b-92742ce73e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:47.837411 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 403/816] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 21:25:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:47.837516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e306979-6cae-493b-972b-92742ce73e6b None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:47.838171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9469b80-41e9-4930-9eab-fb065cf40a17 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:47.838253 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e306979-6cae-493b-972b-92742ce73e6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:47.838511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e306979-6cae-493b-972b-92742ce73e6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:47.839945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e306979-6cae-493b-972b-92742ce73e6b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:47.858562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 414/817] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 21:25:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:47.859373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e306979-6cae-493b-972b-92742ce73e6b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:47.871286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:47.916572 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:47.941918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9469b80-41e9-4930-9eab-fb065cf40a17 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:47.960480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e306979-6cae-493b-972b-92742ce73e6b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:47.976762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8b0e9-4334-4c7a-bdd0-0331379139e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:47.977382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8b0e9-4334-4c7a-bdd0-0331379139e3 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:47.977666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8b0e9-4334-4c7a-bdd0-0331379139e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:47.977943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8b0e9-4334-4c7a-bdd0-0331379139e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:47.978651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8b0e9-4334-4c7a-bdd0-0331379139e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:47.980046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8b0e9-4334-4c7a-bdd0-0331379139e3 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:47.994558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125b5be-28a5-45cb-8271-c53a48ada8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:47.995173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125b5be-28a5-45cb-8271-c53a48ada8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:47.995455 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125b5be-28a5-45cb-8271-c53a48ada8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:47.995730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125b5be-28a5-45cb-8271-c53a48ada8b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:47.996456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125b5be-28a5-45cb-8271-c53a48ada8b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:47.996764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125b5be-28a5-45cb-8271-c53a48ada8b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:47.998122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125b5be-28a5-45cb-8271-c53a48ada8b4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:48.009708 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 415/818] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:48.010564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125b5be-28a5-45cb-8271-c53a48ada8b4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:48.051215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 404/819] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 21:25:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:25:48.052348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8b0e9-4334-4c7a-bdd0-0331379139e3 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:48.103220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:48.141352 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125b5be-28a5-45cb-8271-c53a48ada8b4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:48.179667 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8b0e9-4334-4c7a-bdd0-0331379139e3 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:48.185631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8437283-b01f-4420-9c37-23133b2dc472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:48.186267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8437283-b01f-4420-9c37-23133b2dc472 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:48.186552 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8437283-b01f-4420-9c37-23133b2dc472 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:48.186825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8437283-b01f-4420-9c37-23133b2dc472 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:48.187599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8437283-b01f-4420-9c37-23133b2dc472 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:48.187939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8437283-b01f-4420-9c37-23133b2dc472 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:48.189441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8437283-b01f-4420-9c37-23133b2dc472 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:48.202946 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 416/820] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:48.203539 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8437283-b01f-4420-9c37-23133b2dc472 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:48.207795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:48.217681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4633dda-ec1f-4c39-bd83-fa4dc0c2b192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:48.222685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4633dda-ec1f-4c39-bd83-fa4dc0c2b192 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:48.222685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4633dda-ec1f-4c39-bd83-fa4dc0c2b192 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:48.222685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4633dda-ec1f-4c39-bd83-fa4dc0c2b192 None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:48.222685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4633dda-ec1f-4c39-bd83-fa4dc0c2b192 None admin] RBAC: Adding query filter params (type=network) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:48.222685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4633dda-ec1f-4c39-bd83-fa4dc0c2b192 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:48.222685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4633dda-ec1f-4c39-bd83-fa4dc0c2b192 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:48.227892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 405/821] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 21:25:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:48.228808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4633dda-ec1f-4c39-bd83-fa4dc0c2b192 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:48.316639 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8437283-b01f-4420-9c37-23133b2dc472 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:48.341833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4633dda-ec1f-4c39-bd83-fa4dc0c2b192 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:48.343505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:48.352500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0d414-8a8f-4067-a648-ecfd365d87ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:48.353151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0d414-8a8f-4067-a648-ecfd365d87ff None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:48.353435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0d414-8a8f-4067-a648-ecfd365d87ff None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:48.353715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0d414-8a8f-4067-a648-ecfd365d87ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:48.387337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5d1f-c120-44dd-bce6-7eca2edfa2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:48.388297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5d1f-c120-44dd-bce6-7eca2edfa2bb None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:48.388731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5d1f-c120-44dd-bce6-7eca2edfa2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:48.389152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5d1f-c120-44dd-bce6-7eca2edfa2bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:48.396510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e5d1f-c120-44dd-bce6-7eca2edfa2bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:48.398170 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e5d1f-c120-44dd-bce6-7eca2edfa2bb None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-4e2e5d1f-c120-44dd-bce6-7eca2edfa2bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:48.411146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:48.412514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:48.413581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:48.413581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:48.413581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:48.413581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:48.413581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:48.413581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:48.413581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:48.413581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:48.420142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 406/822] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:48.421165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5d1f-c120-44dd-bce6-7eca2edfa2bb None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:48.427443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0d414-8a8f-4067-a648-ecfd365d87ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:48.428960 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0d414-8a8f-4067-a648-ecfd365d87ff None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:48.474332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:48.526540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5d1f-c120-44dd-bce6-7eca2edfa2bb None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:48.537180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 417/823] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:25:48.538184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0d414-8a8f-4067-a648-ecfd365d87ff None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:48.567560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:48.571514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d36c8-952f-4818-95d0-b717388f85cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:48.572215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d36c8-952f-4818-95d0-b717388f85cb None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:48.572495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d36c8-952f-4818-95d0-b717388f85cb None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:48.572769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d36c8-952f-4818-95d0-b717388f85cb None admin] PATH_INFO: `/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/4c4863a61a484ed4b0dac01e908cd05a/roles/11da9ce3f79148679dbde9eb2c568e55` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:48.574700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d36c8-952f-4818-95d0-b717388f85cb None admin] RBAC: Authorizing `identity:create_grant(project_id=48d9c81feed744bb9e322910711a0d3b, user_id=4c4863a61a484ed4b0dac01e908cd05a, role_id=11da9ce3f79148679dbde9eb2c568e55)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:48.576202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d36c8-952f-4818-95d0-b717388f85cb None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:48.641527 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0d414-8a8f-4067-a648-ecfd365d87ff None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:48.675629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b5425-8f2e-459a-b27c-d210d92f0307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:48.676283 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b5425-8f2e-459a-b27c-d210d92f0307 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:48.676584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b5425-8f2e-459a-b27c-d210d92f0307 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:48.676859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b5425-8f2e-459a-b27c-d210d92f0307 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:48.677610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b5425-8f2e-459a-b27c-d210d92f0307 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:48.678969 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b5425-8f2e-459a-b27c-d210d92f0307 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:48.704093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 407/824] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:25:48 2022] PUT /identity/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/4c4863a61a484ed4b0dac01e908cd05a/roles/11da9ce3f79148679dbde9eb2c568e55 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:25:48.704698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d36c8-952f-4818-95d0-b717388f85cb None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:48.744256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 418/825] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 21:25:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:25:48.745282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b5425-8f2e-459a-b27c-d210d92f0307 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:48.860786 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d36c8-952f-4818-95d0-b717388f85cb None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:48.875567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:48.914981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cb407-5a7c-4c66-ab4d-a8544623e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:48.916280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cb407-5a7c-4c66-ab4d-a8544623e25f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:48.916780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cb407-5a7c-4c66-ab4d-a8544623e25f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:48.917360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cb407-5a7c-4c66-ab4d-a8544623e25f None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:48.918327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cb407-5a7c-4c66-ab4d-a8544623e25f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:48.919158 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cb407-5a7c-4c66-ab4d-a8544623e25f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:48.921207 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cb407-5a7c-4c66-ab4d-a8544623e25f None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:48.937330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 408/826] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:48.939839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:48.943382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cb407-5a7c-4c66-ab4d-a8544623e25f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:48.963170 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b5425-8f2e-459a-b27c-d210d92f0307 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:49.007763 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660db63-aefa-442a-93ba-640d375db0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:49.008437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660db63-aefa-442a-93ba-640d375db0fc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:49.008723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660db63-aefa-442a-93ba-640d375db0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:49.008997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660db63-aefa-442a-93ba-640d375db0fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:49.025135 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660db63-aefa-442a-93ba-640d375db0fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:49.029568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660db63-aefa-442a-93ba-640d375db0fc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-c660db63-aefa-442a-93ba-640d375db0fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:49.054454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:49.055398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:49.056311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:49.056311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:49.056311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:49.056311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:49.058500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 419/827] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:49.065596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660db63-aefa-442a-93ba-640d375db0fc None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:49.088325 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cb407-5a7c-4c66-ab4d-a8544623e25f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:49.128310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bad86-dc6d-40c7-965e-1bbc255190e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:49.129246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bad86-dc6d-40c7-965e-1bbc255190e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:49.129358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bad86-dc6d-40c7-965e-1bbc255190e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:49.129563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bad86-dc6d-40c7-965e-1bbc255190e1 None admin] PATH_INFO: `/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/586e22d3792b4759a38ab4c3bc12cf3b/roles/41a3de4f5213430bb14205f0f3aabadc` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:49.148173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bad86-dc6d-40c7-965e-1bbc255190e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=48d9c81feed744bb9e322910711a0d3b, user_id=586e22d3792b4759a38ab4c3bc12cf3b, role_id=41a3de4f5213430bb14205f0f3aabadc)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:49.149615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bad86-dc6d-40c7-965e-1bbc255190e1 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:49.192145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660db63-aefa-442a-93ba-640d375db0fc None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:49.222919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 409/828] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:25:48 2022] PUT /identity/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/586e22d3792b4759a38ab4c3bc12cf3b/roles/41a3de4f5213430bb14205f0f3aabadc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:25:49.231017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aecdc-373f-4501-a20f-d1d19ee026f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:49.231763 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aecdc-373f-4501-a20f-d1d19ee026f4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:49.232142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aecdc-373f-4501-a20f-d1d19ee026f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:49.232484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aecdc-373f-4501-a20f-d1d19ee026f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:49.233323 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8aecdc-373f-4501-a20f-d1d19ee026f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:49.233707 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8aecdc-373f-4501-a20f-d1d19ee026f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:49.235236 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8aecdc-373f-4501-a20f-d1d19ee026f4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:49.237621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:49.250742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 420/829] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:49.256875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bad86-dc6d-40c7-965e-1bbc255190e1 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:49.288044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:49.381320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bad86-dc6d-40c7-965e-1bbc255190e1 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:49.418755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5e238-b6c5-450b-a6e7-345b439e2225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:49.419832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5e238-b6c5-450b-a6e7-345b439e2225 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:49.420317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5e238-b6c5-450b-a6e7-345b439e2225 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:49.420794 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5e238-b6c5-450b-a6e7-345b439e2225 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:49.428936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5e238-b6c5-450b-a6e7-345b439e2225 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:49.430660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5e238-b6c5-450b-a6e7-345b439e2225 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-3ea5e238-b6c5-450b-a6e7-345b439e2225 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:49.443471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:49.444442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:49.445409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:49.445409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:49.445409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:49.445409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:49.445409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:49.445409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:49.445409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:49.445409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:49.447905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 410/830] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:49.455780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aecdc-373f-4501-a20f-d1d19ee026f4 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:49.566240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aecdc-373f-4501-a20f-d1d19ee026f4 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:49.602960 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670c29e-c9f0-454f-b658-342a772ebc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:49.603590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670c29e-c9f0-454f-b658-342a772ebc4d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:49.603894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670c29e-c9f0-454f-b658-342a772ebc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:49.604167 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670c29e-c9f0-454f-b658-342a772ebc4d None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:49.604920 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670c29e-c9f0-454f-b658-342a772ebc4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:49.605226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670c29e-c9f0-454f-b658-342a772ebc4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:49.606849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670c29e-c9f0-454f-b658-342a772ebc4d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:49.620462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 421/831] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:49.626371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5e238-b6c5-450b-a6e7-345b439e2225 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:49.711924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:49.738546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5e238-b6c5-450b-a6e7-345b439e2225 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:49.774396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7822a-1af9-4d2f-9fd5-a3b45089cbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:49.775021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7822a-1af9-4d2f-9fd5-a3b45089cbab None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:49.775304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7822a-1af9-4d2f-9fd5-a3b45089cbab None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:49.775580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7822a-1af9-4d2f-9fd5-a3b45089cbab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:49.776401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7822a-1af9-4d2f-9fd5-a3b45089cbab None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=7d3d6613476c445b82302df5025f3ce6) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:49.776719 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7822a-1af9-4d2f-9fd5-a3b45089cbab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:49.778140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7822a-1af9-4d2f-9fd5-a3b45089cbab None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:49.785145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 411/832] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:49 2022] GET /identity/v3/role_assignments?user.id=7d3d6613476c445b82302df5025f3ce6&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:50.216551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd940608-b52e-4680-88f8-36c05850c898 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:50.216954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd940608-b52e-4680-88f8-36c05850c898 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:50.217130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd940608-b52e-4680-88f8-36c05850c898 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:50.218728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 422/833] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:50.224481 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cd1bf-a100-440e-977a-e981651fb198 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:50.224930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cd1bf-a100-440e-977a-e981651fb198 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:50.225037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cd1bf-a100-440e-977a-e981651fb198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:50.243403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-b04cd1bf-a100-440e-977a-e981651fb198 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:50.244634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-b04cd1bf-a100-440e-977a-e981651fb198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:50.318428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 412/834] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:50.339723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd940608-b52e-4680-88f8-36c05850c898 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:50.402424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:50.452938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd940608-b52e-4680-88f8-36c05850c898 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:50.489598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805814e-72bb-4782-bff5-c43ef2e22051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:50.490162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805814e-72bb-4782-bff5-c43ef2e22051 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:50.490445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805814e-72bb-4782-bff5-c43ef2e22051 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:50.490721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805814e-72bb-4782-bff5-c43ef2e22051 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:50.491364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805814e-72bb-4782-bff5-c43ef2e22051 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:50.492781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805814e-72bb-4782-bff5-c43ef2e22051 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b805814e-72bb-4782-bff5-c43ef2e22051 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:50.502145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:50.504423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:50.506343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 423/835] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:25:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:50.509378 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cd1bf-a100-440e-977a-e981651fb198 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:50.585911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:50.619249 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cd1bf-a100-440e-977a-e981651fb198 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:50.653012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7cec6-010e-43d1-a7fb-adcdf435ff32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:50.653637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7cec6-010e-43d1-a7fb-adcdf435ff32 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:50.653913 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7cec6-010e-43d1-a7fb-adcdf435ff32 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:50.654183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7cec6-010e-43d1-a7fb-adcdf435ff32 None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:50.654860 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7cec6-010e-43d1-a7fb-adcdf435ff32 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:50.655160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7cec6-010e-43d1-a7fb-adcdf435ff32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:50.656540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7cec6-010e-43d1-a7fb-adcdf435ff32 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:50.662442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 413/836] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:25:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:50.668892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805814e-72bb-4782-bff5-c43ef2e22051 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:50.791463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805814e-72bb-4782-bff5-c43ef2e22051 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:50.809920 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:50.827950 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d6909-27e9-4dee-a29b-68266b3c762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:50.828576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d6909-27e9-4dee-a29b-68266b3c762d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:50.832184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d6909-27e9-4dee-a29b-68266b3c762d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:50.832184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d6909-27e9-4dee-a29b-68266b3c762d None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:50.832184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d6909-27e9-4dee-a29b-68266b3c762d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:50.832184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d6909-27e9-4dee-a29b-68266b3c762d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:50.832184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d6909-27e9-4dee-a29b-68266b3c762d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:50.836833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 424/837] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:25:50 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:50.904066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8481e4-1aaf-410b-8e83-56b743b188da None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:50.904407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8481e4-1aaf-410b-8e83-56b743b188da None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:50.904622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8481e4-1aaf-410b-8e83-56b743b188da None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:50.906102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 414/838] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:50.912244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006790d-4328-48db-b507-33620d13a94a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:50.912872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006790d-4328-48db-b507-33620d13a94a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:50.913385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006790d-4328-48db-b507-33620d13a94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:50.933616 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a006790d-4328-48db-b507-33620d13a94a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:50.935193 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a006790d-4328-48db-b507-33620d13a94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:51.015926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 425/839] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:51.040467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8481e4-1aaf-410b-8e83-56b743b188da None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:51.148703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8481e4-1aaf-410b-8e83-56b743b188da None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:51.195667 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf4696-12ae-4b0a-ac1c-751ffcf15d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:51.196405 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf4696-12ae-4b0a-ac1c-751ffcf15d92 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:51.196688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf4696-12ae-4b0a-ac1c-751ffcf15d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:51.196959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf4696-12ae-4b0a-ac1c-751ffcf15d92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:51.198941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:51.209782 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf4696-12ae-4b0a-ac1c-751ffcf15d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-cecf4696-12ae-4b0a-ac1c-751ffcf15d92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:51.216110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:51.217062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:51.217900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:51.217900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:51.217900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:51.217900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:51.217900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:51.217900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:51.217900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:51.217900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:51.217900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:51.217900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:51.217900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:25:51.217900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:51.217900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 415/840] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:25:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:51.224739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006790d-4328-48db-b507-33620d13a94a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:51.360973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006790d-4328-48db-b507-33620d13a94a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:51.376292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:51.401564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5ace2-133a-45dd-9c13-c34cb3c0c0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:51.402125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5ace2-133a-45dd-9c13-c34cb3c0c0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:51.402406 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5ace2-133a-45dd-9c13-c34cb3c0c0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:51.402678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5ace2-133a-45dd-9c13-c34cb3c0c0e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:51.403261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b11b31-4dcb-4e43-9663-73852caaae3c None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:51.403785 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5ace2-133a-45dd-9c13-c34cb3c0c0e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:51.403785 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5ace2-133a-45dd-9c13-c34cb3c0c0e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:51.404092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b11b31-4dcb-4e43-9663-73852caaae3c None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:51.404254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b11b31-4dcb-4e43-9663-73852caaae3c None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:51.405113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5ace2-133a-45dd-9c13-c34cb3c0c0e6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:51.409625 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 416/841] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:51.414858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b466-9aca-4600-9dbf-48c522fa3e1c None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:51.415384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b466-9aca-4600-9dbf-48c522fa3e1c None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:51.415936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b466-9aca-4600-9dbf-48c522fa3e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:51.420439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 426/842] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:25:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:51.429475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5ace2-133a-45dd-9c13-c34cb3c0c0e6 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:51.439367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-9fb2b466-9aca-4600-9dbf-48c522fa3e1c None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:51.441845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-9fb2b466-9aca-4600-9dbf-48c522fa3e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:51.539678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 417/843] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:51.563681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b466-9aca-4600-9dbf-48c522fa3e1c None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:51.565080 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5ace2-133a-45dd-9c13-c34cb3c0c0e6 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:51.608069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397af270-aa66-4645-9ae1-89ba0f219b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:51.608834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af270-aa66-4645-9ae1-89ba0f219b8e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:51.609375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af270-aa66-4645-9ae1-89ba0f219b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:51.610097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397af270-aa66-4645-9ae1-89ba0f219b8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:51.624791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397af270-aa66-4645-9ae1-89ba0f219b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:51.626676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397af270-aa66-4645-9ae1-89ba0f219b8e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-397af270-aa66-4645-9ae1-89ba0f219b8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:51.643984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:51.644958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:51.645854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:51.645854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:51.645854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:51.645854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:51.650051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 427/844] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:51.651398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397af270-aa66-4645-9ae1-89ba0f219b8e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:51.688607 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:51.699557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b466-9aca-4600-9dbf-48c522fa3e1c None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:51.732171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:51.744985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbcfd2-463a-45a6-9607-2821917458ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:51.745636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbcfd2-463a-45a6-9607-2821917458ed None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:51.745958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbcfd2-463a-45a6-9607-2821917458ed None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:51.746340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbcfd2-463a-45a6-9607-2821917458ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:51.759199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbcfd2-463a-45a6-9607-2821917458ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-01dbcfd2-463a-45a6-9607-2821917458ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:51.768213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:51.769564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:51.770538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:51.770538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:51.770538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:51.770538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:51.770538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:51.770538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:51.770538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:51.770538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:51.770538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:51.770538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:51.770538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:25:51.770538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:51.775785 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 418/845] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:25:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:51.779103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbcfd2-463a-45a6-9607-2821917458ed None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:51.793059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397af270-aa66-4645-9ae1-89ba0f219b8e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:51.842671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f35d7-92f1-4d4a-88c7-83b1606abe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:51.843633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f35d7-92f1-4d4a-88c7-83b1606abe98 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:51.844083 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f35d7-92f1-4d4a-88c7-83b1606abe98 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:51.844585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f35d7-92f1-4d4a-88c7-83b1606abe98 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:51.846665 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f35d7-92f1-4d4a-88c7-83b1606abe98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:51.847133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f35d7-92f1-4d4a-88c7-83b1606abe98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:51.849246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f35d7-92f1-4d4a-88c7-83b1606abe98 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:51.867193 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 428/846] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:51.872889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f35d7-92f1-4d4a-88c7-83b1606abe98 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:51.916422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbcfd2-463a-45a6-9607-2821917458ed None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:51.957333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678c396-0242-432a-ad5a-199b22a86b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:51.958205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678c396-0242-432a-ad5a-199b22a86b81 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:51.958654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678c396-0242-432a-ad5a-199b22a86b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:51.959093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678c396-0242-432a-ad5a-199b22a86b81 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:51.959992 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678c396-0242-432a-ad5a-199b22a86b81 None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:51.960446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678c396-0242-432a-ad5a-199b22a86b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:51.963008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678c396-0242-432a-ad5a-199b22a86b81 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:51.973857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 419/847] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:25:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:51.979013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678c396-0242-432a-ad5a-199b22a86b81 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:51.989829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:52.009396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f35d7-92f1-4d4a-88c7-83b1606abe98 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:52.045519 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:52.052542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f390ac-1db0-4c30-8adf-043a241ce625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:52.053194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f390ac-1db0-4c30-8adf-043a241ce625 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:52.053475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f390ac-1db0-4c30-8adf-043a241ce625 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:52.053749 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f390ac-1db0-4c30-8adf-043a241ce625 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:52.063760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f390ac-1db0-4c30-8adf-043a241ce625 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:52.066131 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f390ac-1db0-4c30-8adf-043a241ce625 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-51f390ac-1db0-4c30-8adf-043a241ce625 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:52.082147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:52.083132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:52.084697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:52.084697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:52.084697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:52.084697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:52.084697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:52.084697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:52.084697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:52.084697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:52.084697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 21:25:52.084697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:52.084697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 429/848] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:25:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:52.085279 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e776e-bd80-4bc5-93f8-82cb3cc59109 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:52.085279 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e776e-bd80-4bc5-93f8-82cb3cc59109 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:52.085398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e776e-bd80-4bc5-93f8-82cb3cc59109 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:52.086821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 430/849] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:52.091468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e776e-bd80-4bc5-93f8-82cb3cc59109 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:52.111604 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678c396-0242-432a-ad5a-199b22a86b81 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:52.148458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abeda36-13aa-46b8-a461-d8413795628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:52.149448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeda36-13aa-46b8-a461-d8413795628c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:52.149725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeda36-13aa-46b8-a461-d8413795628c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:52.149997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeda36-13aa-46b8-a461-d8413795628c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:52.161588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abeda36-13aa-46b8-a461-d8413795628c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:52.163029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abeda36-13aa-46b8-a461-d8413795628c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-0abeda36-13aa-46b8-a461-d8413795628c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:52.178834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:52.179973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:52.180932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:52.180932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:52.180932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:52.180932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:52.184895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 420/850] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:52.186027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965421c1-bbc8-4e4d-9b5c-4e1a36fe818f None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:52.186320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965421c1-bbc8-4e4d-9b5c-4e1a36fe818f None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:52.186598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965421c1-bbc8-4e4d-9b5c-4e1a36fe818f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:52.206057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-965421c1-bbc8-4e4d-9b5c-4e1a36fe818f None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:52.206833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e776e-bd80-4bc5-93f8-82cb3cc59109 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:52.207248 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-965421c1-bbc8-4e4d-9b5c-4e1a36fe818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:52.245309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39394f-3eca-471c-851a-cecf70b9d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:52.245854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39394f-3eca-471c-851a-cecf70b9d694 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:52.246136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39394f-3eca-471c-851a-cecf70b9d694 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:52.246409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39394f-3eca-471c-851a-cecf70b9d694 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:52.247207 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39394f-3eca-471c-851a-cecf70b9d694 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:52.247514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39394f-3eca-471c-851a-cecf70b9d694 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:52.248983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39394f-3eca-471c-851a-cecf70b9d694 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:52.267664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 431/851] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 25 21:25:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:52.268460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39394f-3eca-471c-851a-cecf70b9d694 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:52.275254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:52.285049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 421/852] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:52.286135 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965421c1-bbc8-4e4d-9b5c-4e1a36fe818f None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:52.321688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:52.383292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39394f-3eca-471c-851a-cecf70b9d694 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:52.398578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965421c1-bbc8-4e4d-9b5c-4e1a36fe818f None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:52.417559 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe643d-f510-4782-a601-1b93e9c60935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:52.418188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe643d-f510-4782-a601-1b93e9c60935 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:52.418475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe643d-f510-4782-a601-1b93e9c60935 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:52.418754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe643d-f510-4782-a601-1b93e9c60935 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:52.419452 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe643d-f510-4782-a601-1b93e9c60935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:52.419789 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe643d-f510-4782-a601-1b93e9c60935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:52.421173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe643d-f510-4782-a601-1b93e9c60935 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:52.432894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 432/853] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:52.433709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe643d-f510-4782-a601-1b93e9c60935 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:52.438975 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1e431-cd4a-44cd-80b4-914e8d260828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:52.440340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1e431-cd4a-44cd-80b4-914e8d260828 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:52.440613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1e431-cd4a-44cd-80b4-914e8d260828 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:52.441036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1e431-cd4a-44cd-80b4-914e8d260828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:52.506849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:52.514311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1e431-cd4a-44cd-80b4-914e8d260828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:52.516013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1e431-cd4a-44cd-80b4-914e8d260828 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:52.544170 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:52.553451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe643d-f510-4782-a601-1b93e9c60935 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:52.594388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc815c-c380-4c40-8d31-aedf85b36c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:52.596351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc815c-c380-4c40-8d31-aedf85b36c91 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:52.596725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc815c-c380-4c40-8d31-aedf85b36c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:52.597008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc815c-c380-4c40-8d31-aedf85b36c91 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:52.597662 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc815c-c380-4c40-8d31-aedf85b36c91 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:52.599036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc815c-c380-4c40-8d31-aedf85b36c91 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-77dc815c-c380-4c40-8d31-aedf85b36c91 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:52.614929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:52.615944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:52.616780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 433/854] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Jul 25 21:25:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:52.617632 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc815c-c380-4c40-8d31-aedf85b36c91 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:52.627085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 422/855] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:25:52.628421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1e431-cd4a-44cd-80b4-914e8d260828 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:52.728869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc815c-c380-4c40-8d31-aedf85b36c91 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:52.742159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1e431-cd4a-44cd-80b4-914e8d260828 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:52.757746 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:52.765551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e862cf-bdbd-4e5f-8442-6d578a4c6953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:52.768091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e862cf-bdbd-4e5f-8442-6d578a4c6953 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:52.768091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e862cf-bdbd-4e5f-8442-6d578a4c6953 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:52.768091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e862cf-bdbd-4e5f-8442-6d578a4c6953 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:52.770900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:52.776291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e862cf-bdbd-4e5f-8442-6d578a4c6953 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:52.777792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e862cf-bdbd-4e5f-8442-6d578a4c6953 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:52.779364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c37a-eca8-4e52-a004-9e47a3fdc28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:52.780017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c37a-eca8-4e52-a004-9e47a3fdc28a None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:52.780317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c37a-eca8-4e52-a004-9e47a3fdc28a None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:52.780574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c37a-eca8-4e52-a004-9e47a3fdc28a None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:52.781286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37c37a-eca8-4e52-a004-9e47a3fdc28a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:52.781592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37c37a-eca8-4e52-a004-9e47a3fdc28a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:52.783511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37c37a-eca8-4e52-a004-9e47a3fdc28a None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:52.793416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 423/856] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 21:25:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:52.793416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c37a-eca8-4e52-a004-9e47a3fdc28a None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-74e862cf-bdbd-4e5f-8442-6d578a4c6953 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:52.793659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:52.794762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:52.795703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:52.795703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:52.795703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:52.795703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:52.795703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:52.795703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:52.795703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:52.795703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:52.795703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 21:25:52.795703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:52.795703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 434/857] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 21:25:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:52.795703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e862cf-bdbd-4e5f-8442-6d578a4c6953 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:52.909522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e862cf-bdbd-4e5f-8442-6d578a4c6953 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:52.910553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c37a-eca8-4e52-a004-9e47a3fdc28a None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:52.947707 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8737b2-1fcd-4fe5-a052-eb5cc4df6b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:52.948375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8737b2-1fcd-4fe5-a052-eb5cc4df6b49 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:52.948657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8737b2-1fcd-4fe5-a052-eb5cc4df6b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:52.948928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8737b2-1fcd-4fe5-a052-eb5cc4df6b49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:52.949768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba091b35-2e1e-4345-89f0-30386389a823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:52.950394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba091b35-2e1e-4345-89f0-30386389a823 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:52.950940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba091b35-2e1e-4345-89f0-30386389a823 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:52.951223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba091b35-2e1e-4345-89f0-30386389a823 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:52.952358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba091b35-2e1e-4345-89f0-30386389a823 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:52.952671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba091b35-2e1e-4345-89f0-30386389a823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:52.954052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba091b35-2e1e-4345-89f0-30386389a823 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:52.960400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8737b2-1fcd-4fe5-a052-eb5cc4df6b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:52.967992 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 435/858] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 21:25:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:52.967992 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba091b35-2e1e-4345-89f0-30386389a823 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:52.968276 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8737b2-1fcd-4fe5-a052-eb5cc4df6b49 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-4a8737b2-1fcd-4fe5-a052-eb5cc4df6b49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:52.984930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:52.985912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:52.987686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:52.987686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:52.987686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:52.987686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:52.987686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 424/859] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:52.992736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8737b2-1fcd-4fe5-a052-eb5cc4df6b49 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:53.049015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:53.051666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:53.104086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba091b35-2e1e-4345-89f0-30386389a823 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:53.115730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8737b2-1fcd-4fe5-a052-eb5cc4df6b49 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:53.146108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1df363-e478-48bb-94e7-f00b0b762283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:53.146732 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1df363-e478-48bb-94e7-f00b0b762283 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:53.147015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1df363-e478-48bb-94e7-f00b0b762283 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:53.147293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1df363-e478-48bb-94e7-f00b0b762283 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:53.148522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1df363-e478-48bb-94e7-f00b0b762283 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:53.148522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1df363-e478-48bb-94e7-f00b0b762283 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:53.149906 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1df363-e478-48bb-94e7-f00b0b762283 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:53.165784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07848853-e2c5-432c-bc9c-8bcadcc77b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:53.166410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848853-e2c5-432c-bc9c-8bcadcc77b28 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:53.166690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848853-e2c5-432c-bc9c-8bcadcc77b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:53.166958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07848853-e2c5-432c-bc9c-8bcadcc77b28 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:53.167654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848853-e2c5-432c-bc9c-8bcadcc77b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:53.167988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848853-e2c5-432c-bc9c-8bcadcc77b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:53.169224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 436/860] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 25 21:25:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:53.169334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07848853-e2c5-432c-bc9c-8bcadcc77b28 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:53.173947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894324d-56ca-412b-998c-d78bb3f58407 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:53.173947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894324d-56ca-412b-998c-d78bb3f58407 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:53.173947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894324d-56ca-412b-998c-d78bb3f58407 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:53.173947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 437/861] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:53.177548 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894324d-56ca-412b-998c-d78bb3f58407 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:53.190090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 425/862] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:53.190090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199acaaa-3298-4fec-9eb5-38db3374151f None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:53.190090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199acaaa-3298-4fec-9eb5-38db3374151f None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:53.190090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199acaaa-3298-4fec-9eb5-38db3374151f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:53.206078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-199acaaa-3298-4fec-9eb5-38db3374151f None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:53.207360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-199acaaa-3298-4fec-9eb5-38db3374151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:53.279453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 426/863] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:53.280340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199acaaa-3298-4fec-9eb5-38db3374151f None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:53.301140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894324d-56ca-412b-998c-d78bb3f58407 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:53.316377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:53.316946 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:53.343667 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f5aba-9ea7-42cd-9356-898df93a860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:53.344534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f5aba-9ea7-42cd-9356-898df93a860a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:53.344823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f5aba-9ea7-42cd-9356-898df93a860a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:53.345830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f5aba-9ea7-42cd-9356-898df93a860a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:53.389980 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199acaaa-3298-4fec-9eb5-38db3374151f None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:53.418687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f5aba-9ea7-42cd-9356-898df93a860a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:53.420182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f5aba-9ea7-42cd-9356-898df93a860a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:53.427002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e83c4-4fec-49d0-87fb-2dc2d2187b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:53.427653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e83c4-4fec-49d0-87fb-2dc2d2187b5b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:53.427967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e83c4-4fec-49d0-87fb-2dc2d2187b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:53.428244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e83c4-4fec-49d0-87fb-2dc2d2187b5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:53.435818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e83c4-4fec-49d0-87fb-2dc2d2187b5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:53.437271 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e83c4-4fec-49d0-87fb-2dc2d2187b5b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-5b2e83c4-4fec-49d0-87fb-2dc2d2187b5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:53.449088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:53.450397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:53.451939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:53.451939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:53.451939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:53.451939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:53.451939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:53.451939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:53.451939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:53.451939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:53.451939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 427/864] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:53.451939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e83c4-4fec-49d0-87fb-2dc2d2187b5b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:53.536626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 438/865] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:53 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 21:25:53.537492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f5aba-9ea7-42cd-9356-898df93a860a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:53.552422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:53.558444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:53.565116 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e83c4-4fec-49d0-87fb-2dc2d2187b5b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:53.600331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce5f99-18e4-40a9-86f0-29b8c7637e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:53.601074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce5f99-18e4-40a9-86f0-29b8c7637e62 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:53.601355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce5f99-18e4-40a9-86f0-29b8c7637e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:53.601629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce5f99-18e4-40a9-86f0-29b8c7637e62 None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:53.602318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce5f99-18e4-40a9-86f0-29b8c7637e62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:53.603676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce5f99-18e4-40a9-86f0-29b8c7637e62 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:53.644941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f5aba-9ea7-42cd-9356-898df93a860a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:53.683471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d42c39-30c8-4e06-ad16-7b300dec40d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:53.684129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42c39-30c8-4e06-ad16-7b300dec40d2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:53.684411 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42c39-30c8-4e06-ad16-7b300dec40d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:53.684680 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42c39-30c8-4e06-ad16-7b300dec40d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:53.685503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d42c39-30c8-4e06-ad16-7b300dec40d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:53.685809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d42c39-30c8-4e06-ad16-7b300dec40d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:53.687229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d42c39-30c8-4e06-ad16-7b300dec40d2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:53.702412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 439/866] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:53.703350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d42c39-30c8-4e06-ad16-7b300dec40d2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:53.713201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 428/867] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 21:25:53 2022] POST /identity/v3/services => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:25:53.714925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce5f99-18e4-40a9-86f0-29b8c7637e62 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:53.789856 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:53.832669 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d42c39-30c8-4e06-ad16-7b300dec40d2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:53.884661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ffb2b-b360-4cb4-bcc0-b20e33369f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:53.885762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ffb2b-b360-4cb4-bcc0-b20e33369f57 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:53.886237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ffb2b-b360-4cb4-bcc0-b20e33369f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:53.886514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ffb2b-b360-4cb4-bcc0-b20e33369f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:53.886699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce5f99-18e4-40a9-86f0-29b8c7637e62 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:53.902035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ffb2b-b360-4cb4-bcc0-b20e33369f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:53.904348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ffb2b-b360-4cb4-bcc0-b20e33369f57 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ed6ffb2b-b360-4cb4-bcc0-b20e33369f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:53.922884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:53.924443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:53.925332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:53.925332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:53.925332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:53.925332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:53.925332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 440/868] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:53.932803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ffb2b-b360-4cb4-bcc0-b20e33369f57 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:53.938110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe2200-2396-41da-996f-acc701cff2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:53.938759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe2200-2396-41da-996f-acc701cff2be None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:53.939078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe2200-2396-41da-996f-acc701cff2be None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:53.940022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe2200-2396-41da-996f-acc701cff2be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:53.940829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe2200-2396-41da-996f-acc701cff2be None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=4c4863a61a484ed4b0dac01e908cd05a) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:53.941140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe2200-2396-41da-996f-acc701cff2be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:53.942567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe2200-2396-41da-996f-acc701cff2be None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:53.950705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 429/869] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:53 2022] GET /identity/v3/role_assignments?user.id=4c4863a61a484ed4b0dac01e908cd05a&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:54.059201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ffb2b-b360-4cb4-bcc0-b20e33369f57 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:54.081312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:54.104306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca915dbb-9139-4252-8a06-1f6a85250282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:54.104306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca915dbb-9139-4252-8a06-1f6a85250282 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:54.104306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca915dbb-9139-4252-8a06-1f6a85250282 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:54.104306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca915dbb-9139-4252-8a06-1f6a85250282 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:54.105521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca915dbb-9139-4252-8a06-1f6a85250282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:54.106046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca915dbb-9139-4252-8a06-1f6a85250282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:54.107685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca915dbb-9139-4252-8a06-1f6a85250282 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:54.121955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 441/870] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:54.131762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe2200-2396-41da-996f-acc701cff2be None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:54.147561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:54.253275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe2200-2396-41da-996f-acc701cff2be None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:54.289096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8122-0e1a-4618-aca1-57fddf7a632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:54.289791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8122-0e1a-4618-aca1-57fddf7a632f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:54.290075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8122-0e1a-4618-aca1-57fddf7a632f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:54.290400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a8122-0e1a-4618-aca1-57fddf7a632f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:54.297263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a8122-0e1a-4618-aca1-57fddf7a632f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:54.298749 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a8122-0e1a-4618-aca1-57fddf7a632f None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-d52a8122-0e1a-4618-aca1-57fddf7a632f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:54.310403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:54.311291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:54.312362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:54.312362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:54.312362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:54.312362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:54.312362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:54.312362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:54.312362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:54.312362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:54.312362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 430/871] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:54.319812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca915dbb-9139-4252-8a06-1f6a85250282 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:54.430783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca915dbb-9139-4252-8a06-1f6a85250282 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:54.467458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2926ef-137b-43c9-af84-431fe1a3e66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:54.468162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2926ef-137b-43c9-af84-431fe1a3e66a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:54.468445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2926ef-137b-43c9-af84-431fe1a3e66a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:54.468725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2926ef-137b-43c9-af84-431fe1a3e66a None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:54.469548 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2926ef-137b-43c9-af84-431fe1a3e66a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:54.469862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2926ef-137b-43c9-af84-431fe1a3e66a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:54.471620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2926ef-137b-43c9-af84-431fe1a3e66a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:54.484355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 442/872] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:54.491157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8122-0e1a-4618-aca1-57fddf7a632f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:54.576601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:54.603077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a8122-0e1a-4618-aca1-57fddf7a632f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:54.645205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769d087-3d28-469f-af9e-2fd3505939ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:54.645822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d087-3d28-469f-af9e-2fd3505939ec None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:54.646101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d087-3d28-469f-af9e-2fd3505939ec None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:54.646373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769d087-3d28-469f-af9e-2fd3505939ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:54.647165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769d087-3d28-469f-af9e-2fd3505939ec None admin] RBAC: Adding query filter params (role.id=41a3de4f5213430bb14205f0f3aabadc, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=586e22d3792b4759a38ab4c3bc12cf3b) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:54.647473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769d087-3d28-469f-af9e-2fd3505939ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:54.648914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769d087-3d28-469f-af9e-2fd3505939ec None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:54.655113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 431/873] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:54 2022] GET /identity/v3/role_assignments?user.id=586e22d3792b4759a38ab4c3bc12cf3b&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=41a3de4f5213430bb14205f0f3aabadc => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:55.063248 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a33b67-1b73-4090-bf7a-941ef7f10c3f None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:55.063630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a33b67-1b73-4090-bf7a-941ef7f10c3f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:55.063844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a33b67-1b73-4090-bf7a-941ef7f10c3f None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:55.066007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 443/874] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:55.071084 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ec202-6540-47be-9039-b2ad0091ea42 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:55.071377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ec202-6540-47be-9039-b2ad0091ea42 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:55.071652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ec202-6540-47be-9039-b2ad0091ea42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:55.090267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-017ec202-6540-47be-9039-b2ad0091ea42 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:55.091449 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-017ec202-6540-47be-9039-b2ad0091ea42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:55.162209 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 432/875] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:55.183920 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a33b67-1b73-4090-bf7a-941ef7f10c3f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:55.228313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:55.295905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a33b67-1b73-4090-bf7a-941ef7f10c3f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:55.332176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab72d21-97be-404b-abf2-cce7eacfa964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:55.332720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab72d21-97be-404b-abf2-cce7eacfa964 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:55.333000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab72d21-97be-404b-abf2-cce7eacfa964 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:55.333277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab72d21-97be-404b-abf2-cce7eacfa964 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:55.333973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab72d21-97be-404b-abf2-cce7eacfa964 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:55.335350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab72d21-97be-404b-abf2-cce7eacfa964 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:55.415938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 444/876] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 21:25:55 2022] POST /identity/v3/services => generated 269 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:25:55.844022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a6f35-f12f-4a1d-a5c0-252f983484bb None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:55.844551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a6f35-f12f-4a1d-a5c0-252f983484bb None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:55.844551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a6f35-f12f-4a1d-a5c0-252f983484bb None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:55.846801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 433/877] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:55.852269 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc4812-12bb-47e2-beb5-008904235c84 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:55.853137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc4812-12bb-47e2-beb5-008904235c84 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:55.853626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc4812-12bb-47e2-beb5-008904235c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:55.873119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-1acc4812-12bb-47e2-beb5-008904235c84 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:55.874698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1acc4812-12bb-47e2-beb5-008904235c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:55.956893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 445/878] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:55.980011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a6f35-f12f-4a1d-a5c0-252f983484bb None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:56.051086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:56.087957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a6f35-f12f-4a1d-a5c0-252f983484bb None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:56.125227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ede17c-9680-42d7-9ff3-99d60c33578c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:56.126238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ede17c-9680-42d7-9ff3-99d60c33578c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.127398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ede17c-9680-42d7-9ff3-99d60c33578c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.127916 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ede17c-9680-42d7-9ff3-99d60c33578c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.128753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ede17c-9680-42d7-9ff3-99d60c33578c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:56.130342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ede17c-9680-42d7-9ff3-99d60c33578c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-60ede17c-9680-42d7-9ff3-99d60c33578c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:56.139766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:56.140768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:56.141594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:56.141594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:56.141594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:56.141594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:56.141594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:56.141594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:56.141594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:56.141594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:56.141594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:56.141594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:56.141594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:25:56.141594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:56.141594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:25:56.141594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:56.144420 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 434/879] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:25:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:56.150690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc4812-12bb-47e2-beb5-008904235c84 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:56.177114 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:56.217398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c133a2-375b-4e76-adca-5d8a3f318942 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.217574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c133a2-375b-4e76-adca-5d8a3f318942 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.218000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c133a2-375b-4e76-adca-5d8a3f318942 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.219491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 435/880] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:25:56.225963 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608bd3-47fa-41f2-9ba4-dcded7385955 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.226492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608bd3-47fa-41f2-9ba4-dcded7385955 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.226964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608bd3-47fa-41f2-9ba4-dcded7385955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.250619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-d2608bd3-47fa-41f2-9ba4-dcded7385955 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:56.252386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-d2608bd3-47fa-41f2-9ba4-dcded7385955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:56.263757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc4812-12bb-47e2-beb5-008904235c84 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:56.303855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca977e-0c9f-4298-a3f3-21c5828ab004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:56.304475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca977e-0c9f-4298-a3f3-21c5828ab004 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.304754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca977e-0c9f-4298-a3f3-21c5828ab004 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.305026 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca977e-0c9f-4298-a3f3-21c5828ab004 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.305820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca977e-0c9f-4298-a3f3-21c5828ab004 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:56.306122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca977e-0c9f-4298-a3f3-21c5828ab004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:56.307484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca977e-0c9f-4298-a3f3-21c5828ab004 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:56.313143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 446/881] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:25:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:56.319913 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca977e-0c9f-4298-a3f3-21c5828ab004 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:56.335683 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 436/882] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:56.358043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2608bd3-47fa-41f2-9ba4-dcded7385955 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:56.436095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:56.436295 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:56.449385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca977e-0c9f-4298-a3f3-21c5828ab004 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:56.482910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2608bd3-47fa-41f2-9ba4-dcded7385955 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:56.490213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13486d-ec70-43c5-b27a-8fb78de780ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:56.490912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13486d-ec70-43c5-b27a-8fb78de780ae None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.491191 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13486d-ec70-43c5-b27a-8fb78de780ae None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.491464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13486d-ec70-43c5-b27a-8fb78de780ae None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.492224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13486d-ec70-43c5-b27a-8fb78de780ae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:56.492531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13486d-ec70-43c5-b27a-8fb78de780ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:56.494341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13486d-ec70-43c5-b27a-8fb78de780ae None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:56.501068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 447/883] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:25:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:56.506758 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13486d-ec70-43c5-b27a-8fb78de780ae None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:56.531294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48975f8-bda5-476d-aa89-90cacc2f7d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:56.533944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48975f8-bda5-476d-aa89-90cacc2f7d4b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.534556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48975f8-bda5-476d-aa89-90cacc2f7d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.535091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48975f8-bda5-476d-aa89-90cacc2f7d4b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.536111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48975f8-bda5-476d-aa89-90cacc2f7d4b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:56.538825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48975f8-bda5-476d-aa89-90cacc2f7d4b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-f48975f8-bda5-476d-aa89-90cacc2f7d4b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:56.549750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:56.550947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:56.551934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:56.551934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:56.551934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:56.551934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:56.551934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:56.551934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:56.551934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:56.551934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:56.551934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:56.551934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:56.551934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:25:56.551934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:56.551934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:25:56.551934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:56.565712 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 437/884] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 21:25:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:56.565712 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48975f8-bda5-476d-aa89-90cacc2f7d4b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:56.640786 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13486d-ec70-43c5-b27a-8fb78de780ae None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:56.672788 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48975f8-bda5-476d-aa89-90cacc2f7d4b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:56.690572 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78067827-7414-411c-bff3-05ae76674470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:56.691571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067827-7414-411c-bff3-05ae76674470 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.692099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067827-7414-411c-bff3-05ae76674470 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.692584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067827-7414-411c-bff3-05ae76674470 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.693573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78067827-7414-411c-bff3-05ae76674470 None admin] RBAC: Adding query filter params (interface=public, service_id=cd015fb75eb44b8e9b13a8f6f7cbb867, region_id=RegionOne) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:56.694090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78067827-7414-411c-bff3-05ae76674470 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:56.697255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78067827-7414-411c-bff3-05ae76674470 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:56.705420 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 448/885] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 21:25:56 2022] GET /identity/v3/endpoints?service_id=cd015fb75eb44b8e9b13a8f6f7cbb867&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:56.709572 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:56.711503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78067827-7414-411c-bff3-05ae76674470 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:56.721283 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b7b33-040e-438e-a8d4-4e3103b363dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:56.726194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b7b33-040e-438e-a8d4-4e3103b363dd None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.726194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b7b33-040e-438e-a8d4-4e3103b363dd None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.726194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b7b33-040e-438e-a8d4-4e3103b363dd None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.726194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b7b33-040e-438e-a8d4-4e3103b363dd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:56.726194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b7b33-040e-438e-a8d4-4e3103b363dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:56.726194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b7b33-040e-438e-a8d4-4e3103b363dd None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:56.734038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:56.735458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 438/886] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 21:25:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:56.736744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b7b33-040e-438e-a8d4-4e3103b363dd None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:56.835368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78067827-7414-411c-bff3-05ae76674470 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:56.846531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b7b33-040e-438e-a8d4-4e3103b363dd None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:56.873181 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bf453-8905-4e6a-8c9e-0064b74fdc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:56.873793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bf453-8905-4e6a-8c9e-0064b74fdc72 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.874076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bf453-8905-4e6a-8c9e-0064b74fdc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.874347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bf453-8905-4e6a-8c9e-0064b74fdc72 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.875102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bf453-8905-4e6a-8c9e-0064b74fdc72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:56.877255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bf453-8905-4e6a-8c9e-0064b74fdc72 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:56.881508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc345957-321c-4d55-a49b-1e3ea88b938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:56.882130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345957-321c-4d55-a49b-1e3ea88b938b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.882411 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345957-321c-4d55-a49b-1e3ea88b938b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.882686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc345957-321c-4d55-a49b-1e3ea88b938b None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.883363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc345957-321c-4d55-a49b-1e3ea88b938b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:56.883669 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc345957-321c-4d55-a49b-1e3ea88b938b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:56.885047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc345957-321c-4d55-a49b-1e3ea88b938b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:56.890025 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 439/887] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 21:25:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:56.891117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca2fee-da92-4737-a318-1129c5aa64cc None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.891406 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca2fee-da92-4737-a318-1129c5aa64cc None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.891686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca2fee-da92-4737-a318-1129c5aa64cc None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.892208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 449/888] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 21:25:56 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:25:56.893260 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 440/889] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:56.899840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd8b66-ba89-4f6b-a929-9dd2d8d67599 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:56.899840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd8b66-ba89-4f6b-a929-9dd2d8d67599 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:56.899840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd8b66-ba89-4f6b-a929-9dd2d8d67599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:56.928783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f5bd8b66-ba89-4f6b-a929-9dd2d8d67599 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:56.930012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f5bd8b66-ba89-4f6b-a929-9dd2d8d67599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:57.017970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 450/890] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:57.041988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca2fee-da92-4737-a318-1129c5aa64cc None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:57.111940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:57.162881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca2fee-da92-4737-a318-1129c5aa64cc None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:57.198387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463468c-f233-45da-b540-6ad6ebd845dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:57.199036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463468c-f233-45da-b540-6ad6ebd845dc None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:57.199316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463468c-f233-45da-b540-6ad6ebd845dc None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:57.199662 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463468c-f233-45da-b540-6ad6ebd845dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:57.210581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463468c-f233-45da-b540-6ad6ebd845dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-0463468c-f233-45da-b540-6ad6ebd845dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:25:57.216328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:57.217256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:57.218097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:57.218097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:57.218097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:57.218097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:57.218097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:25:57.218097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:25:57.218097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:25:57.218097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:25:57.218097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:25:57.218097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:25:57.218097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 21:25:57.218097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:57.218097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 441/891] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 25 21:25:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:57.226912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd8b66-ba89-4f6b-a929-9dd2d8d67599 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:57.240785 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:57.337625 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd8b66-ba89-4f6b-a929-9dd2d8d67599 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:57.373419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef49e5-bfde-4a9a-af53-fb5a4f88e80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:57.374452 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef49e5-bfde-4a9a-af53-fb5a4f88e80c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:57.374730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef49e5-bfde-4a9a-af53-fb5a4f88e80c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:57.375000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef49e5-bfde-4a9a-af53-fb5a4f88e80c None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:57.375721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef49e5-bfde-4a9a-af53-fb5a4f88e80c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:57.376052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef49e5-bfde-4a9a-af53-fb5a4f88e80c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:57.378471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef49e5-bfde-4a9a-af53-fb5a4f88e80c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:57.387103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 451/892] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 25 21:25:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:57.393934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463468c-f233-45da-b540-6ad6ebd845dc None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:57.501320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463468c-f233-45da-b540-6ad6ebd845dc None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:57.520251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:57.542041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20f3af-4744-4cea-a161-87deee3246da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:57.548956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f3af-4744-4cea-a161-87deee3246da None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:57.548956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f3af-4744-4cea-a161-87deee3246da None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:57.548956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f3af-4744-4cea-a161-87deee3246da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:57.555692 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0910b-d5b8-42fb-99ca-1776292d1ada None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:57.556023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0910b-d5b8-42fb-99ca-1776292d1ada None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:57.556310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0910b-d5b8-42fb-99ca-1776292d1ada None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:57.556799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20f3af-4744-4cea-a161-87deee3246da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:57.557912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 452/893] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:25:57.558654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20f3af-4744-4cea-a161-87deee3246da None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:57.562731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f79da-0b68-4fd7-8810-eef51654c0c2 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:57.563017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f79da-0b68-4fd7-8810-eef51654c0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:57.563292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f79da-0b68-4fd7-8810-eef51654c0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-4d20f3af-4744-4cea-a161-87deee3246da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:57.576742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:57.578614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:57.579755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:57.579755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:57.579755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:57.579755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:57.581231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 442/894] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:57.586714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20f3af-4744-4cea-a161-87deee3246da None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:57.588928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e48f79da-0b68-4fd7-8810-eef51654c0c2 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:57.590364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e48f79da-0b68-4fd7-8810-eef51654c0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:57.683087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 453/895] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:25:57.709290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f79da-0b68-4fd7-8810-eef51654c0c2 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:57.711932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:57.730569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20f3af-4744-4cea-a161-87deee3246da None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:57.776882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b3f9d-e302-4c1d-9ee1-047a8d29b46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:57.778044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b3f9d-e302-4c1d-9ee1-047a8d29b46c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:57.778332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b3f9d-e302-4c1d-9ee1-047a8d29b46c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:57.778614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b3f9d-e302-4c1d-9ee1-047a8d29b46c None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:57.779436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b3f9d-e302-4c1d-9ee1-047a8d29b46c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:57.779910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b3f9d-e302-4c1d-9ee1-047a8d29b46c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:57.781598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b3f9d-e302-4c1d-9ee1-047a8d29b46c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:57.798898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 443/896] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:57.804481 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b3f9d-e302-4c1d-9ee1-047a8d29b46c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:57.828778 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f79da-0b68-4fd7-8810-eef51654c0c2 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:57.840004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:57.866151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41749b-5681-428d-95dc-637edfce1c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:57.866827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41749b-5681-428d-95dc-637edfce1c5c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:57.867112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41749b-5681-428d-95dc-637edfce1c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:57.867389 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41749b-5681-428d-95dc-637edfce1c5c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:57.868116 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41749b-5681-428d-95dc-637edfce1c5c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:57.869453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41749b-5681-428d-95dc-637edfce1c5c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-da41749b-5681-428d-95dc-637edfce1c5c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:57.879008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:57.880354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:25:57.881172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:25:57.885048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 454/897] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Jul 25 21:25:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:25:57.885871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41749b-5681-428d-95dc-637edfce1c5c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:57.935082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b3f9d-e302-4c1d-9ee1-047a8d29b46c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:57.970625 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:57.974553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faad38-239b-4596-aa2f-e5ff9c95a3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:57.975568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faad38-239b-4596-aa2f-e5ff9c95a3df None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:57.976828 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faad38-239b-4596-aa2f-e5ff9c95a3df None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:57.977319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faad38-239b-4596-aa2f-e5ff9c95a3df None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:57.986273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faad38-239b-4596-aa2f-e5ff9c95a3df None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:57.988446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faad38-239b-4596-aa2f-e5ff9c95a3df None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-e1faad38-239b-4596-aa2f-e5ff9c95a3df None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:25:58.006523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:58.007582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:58.008555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:58.008555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:58.008555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:25:58.008555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:25:58.008555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:25:58.008555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:25:58.008555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:25:58.008555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:25:58.008555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 21:25:58.008555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:58.014333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 444/898] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 21:25:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:58.015142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faad38-239b-4596-aa2f-e5ff9c95a3df None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:58.018405 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41749b-5681-428d-95dc-637edfce1c5c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:58.057703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481aeecc-26ce-430c-806c-f24800830e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:58.058805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aeecc-26ce-430c-806c-f24800830e9d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:58.059319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aeecc-26ce-430c-806c-f24800830e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:58.059841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aeecc-26ce-430c-806c-f24800830e9d None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:58.060832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481aeecc-26ce-430c-806c-f24800830e9d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:58.061345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481aeecc-26ce-430c-806c-f24800830e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:58.062999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481aeecc-26ce-430c-806c-f24800830e9d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:58.073943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 455/899] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 21:25:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:58.075096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481aeecc-26ce-430c-806c-f24800830e9d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:58.107956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:58.124863 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faad38-239b-4596-aa2f-e5ff9c95a3df None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:58.161644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbd87e-1de3-4187-9580-c5772cf9397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:58.162267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbd87e-1de3-4187-9580-c5772cf9397f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:58.162546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbd87e-1de3-4187-9580-c5772cf9397f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:58.162817 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbd87e-1de3-4187-9580-c5772cf9397f None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:58.163617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbd87e-1de3-4187-9580-c5772cf9397f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:58.163939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbd87e-1de3-4187-9580-c5772cf9397f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:58.165358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbd87e-1de3-4187-9580-c5772cf9397f None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:58.191591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 445/900] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 25 21:25:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:58.192608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbd87e-1de3-4187-9580-c5772cf9397f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:58.194244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481aeecc-26ce-430c-806c-f24800830e9d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:58.243718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:58.253982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4f3e0-55f3-4dd5-a411-54778392947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:58.257918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4f3e0-55f3-4dd5-a411-54778392947d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:58.257918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4f3e0-55f3-4dd5-a411-54778392947d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:58.257918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4f3e0-55f3-4dd5-a411-54778392947d None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:58.257918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4f3e0-55f3-4dd5-a411-54778392947d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:58.257918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4f3e0-55f3-4dd5-a411-54778392947d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:58.260120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4f3e0-55f3-4dd5-a411-54778392947d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:58.272074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 456/901] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 21:25:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:25:58.274335 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4f3e0-55f3-4dd5-a411-54778392947d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:58.340575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbd87e-1de3-4187-9580-c5772cf9397f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:58.384488 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4f3e0-55f3-4dd5-a411-54778392947d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:58.386678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db3742-0d7c-47e9-947b-d303d70a383f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:58.388106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db3742-0d7c-47e9-947b-d303d70a383f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:58.388106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db3742-0d7c-47e9-947b-d303d70a383f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:58.388106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db3742-0d7c-47e9-947b-d303d70a383f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:58.403811 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:58.432485 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e334f5-1ae1-40eb-8504-a478b609df66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:58.433298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e334f5-1ae1-40eb-8504-a478b609df66 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:58.433671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e334f5-1ae1-40eb-8504-a478b609df66 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:58.434039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e334f5-1ae1-40eb-8504-a478b609df66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:58.434950 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e334f5-1ae1-40eb-8504-a478b609df66 None admin] RBAC: Adding query filter params (interface=public, service_id=5886d95a3a654a4daa19596f1a6c8b79, region_id=RegionOne) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:58.435357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e334f5-1ae1-40eb-8504-a478b609df66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:58.437011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e334f5-1ae1-40eb-8504-a478b609df66 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:58.443784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 457/902] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 21:25:58 2022] GET /identity/v3/endpoints?service_id=5886d95a3a654a4daa19596f1a6c8b79&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:58.448775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e334f5-1ae1-40eb-8504-a478b609df66 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:58.480218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db3742-0d7c-47e9-947b-d303d70a383f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:58.482391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db3742-0d7c-47e9-947b-d303d70a383f None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:58.521372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:58.580147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e334f5-1ae1-40eb-8504-a478b609df66 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:58.603493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 446/903] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:25:58 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:25:58.604728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db3742-0d7c-47e9-947b-d303d70a383f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:58.624178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9092882-239a-4a60-85ba-2ae089a3ded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:58.624800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9092882-239a-4a60-85ba-2ae089a3ded6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:58.625093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9092882-239a-4a60-85ba-2ae089a3ded6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:58.625655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9092882-239a-4a60-85ba-2ae089a3ded6 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:58.626846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9092882-239a-4a60-85ba-2ae089a3ded6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:58.628327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9092882-239a-4a60-85ba-2ae089a3ded6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:58.639896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 458/904] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 21:25:58 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:25:58.665887 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:58.735445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db3742-0d7c-47e9-947b-d303d70a383f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:58.775077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cd73e-677c-4a0a-9af4-60b2b9931ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:58.775759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cd73e-677c-4a0a-9af4-60b2b9931ecb None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:58.776047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cd73e-677c-4a0a-9af4-60b2b9931ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:58.776322 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cd73e-677c-4a0a-9af4-60b2b9931ecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:58.790478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cd73e-677c-4a0a-9af4-60b2b9931ecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:58.791996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cd73e-677c-4a0a-9af4-60b2b9931ecb None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-093cd73e-677c-4a0a-9af4-60b2b9931ecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:25:58.808112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:58.809140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:58.810101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:25:58.810101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:25:58.810101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:25:58.810101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:58.810101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 447/905] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:58.815502 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9092882-239a-4a60-85ba-2ae089a3ded6 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:58.924348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9092882-239a-4a60-85ba-2ae089a3ded6 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:58.947667 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:58.961000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c699e22-4f7c-44c6-9586-76b3571e8b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:58.965086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c699e22-4f7c-44c6-9586-76b3571e8b71 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:58.965086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c699e22-4f7c-44c6-9586-76b3571e8b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:58.965086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c699e22-4f7c-44c6-9586-76b3571e8b71 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:58.965086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c699e22-4f7c-44c6-9586-76b3571e8b71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:58.965086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c699e22-4f7c-44c6-9586-76b3571e8b71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:58.965086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c699e22-4f7c-44c6-9586-76b3571e8b71 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:58.977462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 459/906] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:58.982968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cd73e-677c-4a0a-9af4-60b2b9931ecb None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:59.015477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724586ac-0414-4b4b-b079-0b09a9b50cf8 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:59.015804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724586ac-0414-4b4b-b079-0b09a9b50cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:59.016056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724586ac-0414-4b4b-b079-0b09a9b50cf8 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:59.018105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 460/907] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:25:59.024128 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dcf69-561c-44bd-9679-bb513c983661 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:59.024564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dcf69-561c-44bd-9679-bb513c983661 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:59.024943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dcf69-561c-44bd-9679-bb513c983661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:59.044090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e59dcf69-561c-44bd-9679-bb513c983661 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:59.045536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e59dcf69-561c-44bd-9679-bb513c983661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:59.092012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:59.099778 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cd73e-677c-4a0a-9af4-60b2b9931ecb None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:59.135120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 461/908] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:59.138008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e890b-3473-4006-b876-483eb2a22fbf None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:59.138580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e890b-3473-4006-b876-483eb2a22fbf None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:59.139043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e890b-3473-4006-b876-483eb2a22fbf None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:59.142455 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e83098-b944-4d2b-812f-91b7130509ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:59.143534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e83098-b944-4d2b-812f-91b7130509ae None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:59.144061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e83098-b944-4d2b-812f-91b7130509ae None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:59.144610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e83098-b944-4d2b-812f-91b7130509ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:59.144846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 462/909] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:25:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:25:59.145928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6fb0d-578f-4499-ac61-055296244c00 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:59.146214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6fb0d-578f-4499-ac61-055296244c00 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:59.146491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6fb0d-578f-4499-ac61-055296244c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:59.153208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e83098-b944-4d2b-812f-91b7130509ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:59.155060 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e83098-b944-4d2b-812f-91b7130509ae None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:59.165721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-98d6fb0d-578f-4499-ac61-055296244c00 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:25:59.166898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-98d6fb0d-578f-4499-ac61-055296244c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-73e83098-b944-4d2b-812f-91b7130509ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:25:59.168553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:59.169436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:59.170345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:25:59.170345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:25:59.170345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:25:59.170345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:25:59.170345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:25:59.170345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:25:59.170345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:25:59.170345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:59.170345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 448/910] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:25:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:59.170939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e83098-b944-4d2b-812f-91b7130509ae None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:59.249316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 463/911] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:25:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:25:59.249977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6fb0d-578f-4499-ac61-055296244c00 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:59.283526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e83098-b944-4d2b-812f-91b7130509ae None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:59.297748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:59.321781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1c19d-8e54-4292-b881-f7dbbcf6b032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:59.322428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1c19d-8e54-4292-b881-f7dbbcf6b032 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:59.322713 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1c19d-8e54-4292-b881-f7dbbcf6b032 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:59.322990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1c19d-8e54-4292-b881-f7dbbcf6b032 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:59.323621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1c19d-8e54-4292-b881-f7dbbcf6b032 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:59.325016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1c19d-8e54-4292-b881-f7dbbcf6b032 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-00a1c19d-8e54-4292-b881-f7dbbcf6b032 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:25:59.334078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:25:59.335100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:25:59.336711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 449/912] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:25:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:25:59.337545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1c19d-8e54-4292-b881-f7dbbcf6b032 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:59.360295 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6fb0d-578f-4499-ac61-055296244c00 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:59.362567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:59.398566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089dd9f-78ce-43c8-8a51-3ff6a6a413dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:59.399185 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089dd9f-78ce-43c8-8a51-3ff6a6a413dc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:59.399464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089dd9f-78ce-43c8-8a51-3ff6a6a413dc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:59.399766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089dd9f-78ce-43c8-8a51-3ff6a6a413dc None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:59.400624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089dd9f-78ce-43c8-8a51-3ff6a6a413dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:59.400931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089dd9f-78ce-43c8-8a51-3ff6a6a413dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:59.402470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089dd9f-78ce-43c8-8a51-3ff6a6a413dc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:59.420117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 464/913] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:59.421782 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089dd9f-78ce-43c8-8a51-3ff6a6a413dc None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:59.444866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1c19d-8e54-4292-b881-f7dbbcf6b032 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:59.480394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f17356-8e90-4cdf-9aeb-b92c63e2d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:59.481015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f17356-8e90-4cdf-9aeb-b92c63e2d4df None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:59.481297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f17356-8e90-4cdf-9aeb-b92c63e2d4df None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:59.481572 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f17356-8e90-4cdf-9aeb-b92c63e2d4df None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:59.482263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f17356-8e90-4cdf-9aeb-b92c63e2d4df None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:59.483621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f17356-8e90-4cdf-9aeb-b92c63e2d4df None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:59.528659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089dd9f-78ce-43c8-8a51-3ff6a6a413dc None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:59.530195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:59.565922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79945e42-2642-4b12-9d23-62fcc587d79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:59.566549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79945e42-2642-4b12-9d23-62fcc587d79f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:59.566849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79945e42-2642-4b12-9d23-62fcc587d79f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:59.567125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79945e42-2642-4b12-9d23-62fcc587d79f None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:59.576167 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 450/914] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 21:25:59 2022] POST /identity/v3/services => generated 241 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:25:59.576362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79945e42-2642-4b12-9d23-62fcc587d79f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:59.576362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79945e42-2642-4b12-9d23-62fcc587d79f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:59.576568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f17356-8e90-4cdf-9aeb-b92c63e2d4df None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:59.576687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79945e42-2642-4b12-9d23-62fcc587d79f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:59.576687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 465/915] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:25:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:59.582354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79945e42-2642-4b12-9d23-62fcc587d79f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:59.705237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:59.720717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79945e42-2642-4b12-9d23-62fcc587d79f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:59.733417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f17356-8e90-4cdf-9aeb-b92c63e2d4df None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:59.762257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61832e-5c26-466e-acfb-8b21f15e3e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:59.762891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61832e-5c26-466e-acfb-8b21f15e3e6f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:59.763172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61832e-5c26-466e-acfb-8b21f15e3e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:59.763446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61832e-5c26-466e-acfb-8b21f15e3e6f None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:59.764163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61832e-5c26-466e-acfb-8b21f15e3e6f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:59.764472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61832e-5c26-466e-acfb-8b21f15e3e6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:59.765968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61832e-5c26-466e-acfb-8b21f15e3e6f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:59.771225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 466/916] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 25 21:25:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:59.776824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61832e-5c26-466e-acfb-8b21f15e3e6f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:25:59.777382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd42497-4201-4c02-9054-ee79d8ec0c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:59.778068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd42497-4201-4c02-9054-ee79d8ec0c64 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:59.778372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd42497-4201-4c02-9054-ee79d8ec0c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:59.778634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd42497-4201-4c02-9054-ee79d8ec0c64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:59.779491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd42497-4201-4c02-9054-ee79d8ec0c64 None admin] RBAC: Adding query filter params (role.id=631665972a484e5cbab7d504f76b20e4, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=586e22d3792b4759a38ab4c3bc12cf3b) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:25:59.779824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd42497-4201-4c02-9054-ee79d8ec0c64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:59.781207 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd42497-4201-4c02-9054-ee79d8ec0c64 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:25:59.789259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 451/917] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:25:59 2022] GET /identity/v3/role_assignments?user.id=586e22d3792b4759a38ab4c3bc12cf3b&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=631665972a484e5cbab7d504f76b20e4 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:25:59.819970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:25:59.912134 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61832e-5c26-466e-acfb-8b21f15e3e6f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:25:59.955609 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6265e-f1c8-4562-a229-ed5d104ecd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:25:59.956348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6265e-f1c8-4562-a229-ed5d104ecd8b None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:25:59.956652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6265e-f1c8-4562-a229-ed5d104ecd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:25:59.956815 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6265e-f1c8-4562-a229-ed5d104ecd8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:25:59.957556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6265e-f1c8-4562-a229-ed5d104ecd8b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:25:59.958944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6265e-f1c8-4562-a229-ed5d104ecd8b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:00.048754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 467/918] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 21:25:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:26:00.818686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec739d64-39b0-495b-8d24-aa5a7d85dd29 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:00.819246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec739d64-39b0-495b-8d24-aa5a7d85dd29 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:00.819491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec739d64-39b0-495b-8d24-aa5a7d85dd29 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:00.821334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 452/919] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:00.827014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5178e-6754-4dd9-ad23-5805f6e89a5b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:00.827425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5178e-6754-4dd9-ad23-5805f6e89a5b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:00.827832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5178e-6754-4dd9-ad23-5805f6e89a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:00.849063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c2c5178e-6754-4dd9-ad23-5805f6e89a5b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:00.850244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c2c5178e-6754-4dd9-ad23-5805f6e89a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:00.932630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 468/920] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:00.956524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec739d64-39b0-495b-8d24-aa5a7d85dd29 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:01.067865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec739d64-39b0-495b-8d24-aa5a7d85dd29 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:01.103983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba96292-1bfc-4601-b79e-ae13d6e9757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:01.104620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba96292-1bfc-4601-b79e-ae13d6e9757f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:01.104939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba96292-1bfc-4601-b79e-ae13d6e9757f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:01.105211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba96292-1bfc-4601-b79e-ae13d6e9757f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:01.105834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba96292-1bfc-4601-b79e-ae13d6e9757f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:01.107173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba96292-1bfc-4601-b79e-ae13d6e9757f None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-4ba96292-1bfc-4601-b79e-ae13d6e9757f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:01.116793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:01.117747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:01.119673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 453/921] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Jul 25 21:26:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:01.124161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5178e-6754-4dd9-ad23-5805f6e89a5b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:01.139968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:01.231417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5178e-6754-4dd9-ad23-5805f6e89a5b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:01.270250 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d064fa-db7a-446b-9aa6-ad726744a95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:01.270883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d064fa-db7a-446b-9aa6-ad726744a95a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:01.271166 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d064fa-db7a-446b-9aa6-ad726744a95a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:01.271439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d064fa-db7a-446b-9aa6-ad726744a95a None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:01.272158 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d064fa-db7a-446b-9aa6-ad726744a95a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:01.272467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d064fa-db7a-446b-9aa6-ad726744a95a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:01.274227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d064fa-db7a-446b-9aa6-ad726744a95a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:01.280417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 469/922] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 21:26:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:01.287502 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba96292-1bfc-4601-b79e-ae13d6e9757f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:01.291399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:01.398287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba96292-1bfc-4601-b79e-ae13d6e9757f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:01.434442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1657793-5f82-4755-8a26-ac5de34713ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:01.435062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1657793-5f82-4755-8a26-ac5de34713ca None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:01.435378 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1657793-5f82-4755-8a26-ac5de34713ca None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:01.435658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1657793-5f82-4755-8a26-ac5de34713ca None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:01.436368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1657793-5f82-4755-8a26-ac5de34713ca None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:01.436670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1657793-5f82-4755-8a26-ac5de34713ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:01.438034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1657793-5f82-4755-8a26-ac5de34713ca None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:01.444850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 454/923] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 21:26:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:01.450443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d064fa-db7a-446b-9aa6-ad726744a95a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:01.533623 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:01.557737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d064fa-db7a-446b-9aa6-ad726744a95a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:01.596899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f418f8-f64a-406c-8681-3579f14f980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:01.597582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f418f8-f64a-406c-8681-3579f14f980b None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:01.597868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f418f8-f64a-406c-8681-3579f14f980b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:01.598142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f418f8-f64a-406c-8681-3579f14f980b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:01.598871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f418f8-f64a-406c-8681-3579f14f980b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:01.600268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f418f8-f64a-406c-8681-3579f14f980b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:01.723245 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 470/924] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 21:26:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:26:01.766183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8939af9-d169-4912-9035-302f34abaa3d None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:01.766628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8939af9-d169-4912-9035-302f34abaa3d None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:01.767569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8939af9-d169-4912-9035-302f34abaa3d None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:01.769396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 455/925] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:01.775220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1fad-3e2b-470e-aa29-fa9f5713bee5 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:01.775653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1fad-3e2b-470e-aa29-fa9f5713bee5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:01.776116 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b1fad-3e2b-470e-aa29-fa9f5713bee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:01.796547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ee8b1fad-3e2b-470e-aa29-fa9f5713bee5 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:01.797746 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ee8b1fad-3e2b-470e-aa29-fa9f5713bee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:01.844655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64211a6-e4ab-4aca-8865-19def95c8539 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:01.846201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64211a6-e4ab-4aca-8865-19def95c8539 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:01.846201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64211a6-e4ab-4aca-8865-19def95c8539 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:01.847435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 456/926] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:01.852982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb676301-c2b7-444f-af98-6cc7e0ec7680 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:01.853259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb676301-c2b7-444f-af98-6cc7e0ec7680 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:01.853540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb676301-c2b7-444f-af98-6cc7e0ec7680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:01.878618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-eb676301-c2b7-444f-af98-6cc7e0ec7680 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:01.880434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-eb676301-c2b7-444f-af98-6cc7e0ec7680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:01.891001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 471/927] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:01.915448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b1fad-3e2b-470e-aa29-fa9f5713bee5 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:01.953513 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:01.960563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 457/928] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:01.984286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb676301-c2b7-444f-af98-6cc7e0ec7680 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:01.985721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:02.039138 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b1fad-3e2b-470e-aa29-fa9f5713bee5 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:02.082233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9e64a-8e51-4692-bb8d-84304c1f901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:02.082802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9e64a-8e51-4692-bb8d-84304c1f901b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:02.083082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9e64a-8e51-4692-bb8d-84304c1f901b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:02.083352 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9e64a-8e51-4692-bb8d-84304c1f901b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:02.084636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9e64a-8e51-4692-bb8d-84304c1f901b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:02.085741 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9e64a-8e51-4692-bb8d-84304c1f901b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-dee9e64a-8e51-4692-bb8d-84304c1f901b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:02.097277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:02.098316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:02.099542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 472/929] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 21:26:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:02.104478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9e64a-8e51-4692-bb8d-84304c1f901b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:02.127128 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb676301-c2b7-444f-af98-6cc7e0ec7680 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:02.180777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe7bbc-ae09-42db-ae87-53c6ca707431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:02.181783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7bbc-ae09-42db-ae87-53c6ca707431 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:02.182271 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7bbc-ae09-42db-ae87-53c6ca707431 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:02.182998 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7bbc-ae09-42db-ae87-53c6ca707431 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:02.198007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe7bbc-ae09-42db-ae87-53c6ca707431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-29fe7bbc-ae09-42db-ae87-53c6ca707431 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:26:02.203004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:02.203999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:02.205627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:02.205627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:02.205627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:02.205627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:02.205627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:26:02.205627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:26:02.205627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:26:02.205627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:26:02.205627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:26:02.205627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:26:02.205627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 21:26:02.205627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:02.205627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 458/930] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 25 21:26:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:02.206345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec6bee-1653-4ba3-a92a-d5cd1c6f11f8 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:02.206345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec6bee-1653-4ba3-a92a-d5cd1c6f11f8 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:02.206618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec6bee-1653-4ba3-a92a-d5cd1c6f11f8 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:02.209701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 459/931] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:02.210275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec6bee-1653-4ba3-a92a-d5cd1c6f11f8 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:02.226603 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9e64a-8e51-4692-bb8d-84304c1f901b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:02.250147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:02.262842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da869bb0-68e6-4c4c-a7a5-7b7aee8d89b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:02.263477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da869bb0-68e6-4c4c-a7a5-7b7aee8d89b6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:02.263873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da869bb0-68e6-4c4c-a7a5-7b7aee8d89b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:02.264508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da869bb0-68e6-4c4c-a7a5-7b7aee8d89b6 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:02.265215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da869bb0-68e6-4c4c-a7a5-7b7aee8d89b6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:02.265527 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da869bb0-68e6-4c4c-a7a5-7b7aee8d89b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:02.267998 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da869bb0-68e6-4c4c-a7a5-7b7aee8d89b6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:02.278889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 473/932] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 21:26:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:02.278889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07886ae-ac0a-47e4-a3a5-8d14537a0a26 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:02.278889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07886ae-ac0a-47e4-a3a5-8d14537a0a26 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:02.278889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07886ae-ac0a-47e4-a3a5-8d14537a0a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:02.288654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:02.297447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d07886ae-ac0a-47e4-a3a5-8d14537a0a26 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:02.299327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d07886ae-ac0a-47e4-a3a5-8d14537a0a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:02.335375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec6bee-1653-4ba3-a92a-d5cd1c6f11f8 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:02.372345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 474/933] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:02.373029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3c7c7-d483-4118-85c6-e800ca9118e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:02.373174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07886ae-ac0a-47e4-a3a5-8d14537a0a26 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:02.374070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3c7c7-d483-4118-85c6-e800ca9118e4 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:02.374569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3c7c7-d483-4118-85c6-e800ca9118e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:02.375110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3c7c7-d483-4118-85c6-e800ca9118e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:02.376077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3c7c7-d483-4118-85c6-e800ca9118e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:02.376446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3c7c7-d483-4118-85c6-e800ca9118e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:02.377876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3c7c7-d483-4118-85c6-e800ca9118e4 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:02.391355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 460/934] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 25 21:26:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:02.397773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3c7c7-d483-4118-85c6-e800ca9118e4 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:02.491611 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07886ae-ac0a-47e4-a3a5-8d14537a0a26 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:02.511763 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:02.513357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3c7c7-d483-4118-85c6-e800ca9118e4 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:02.529203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca67e52-37da-4ac3-af10-3b818ffa2ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:02.529837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca67e52-37da-4ac3-af10-3b818ffa2ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:02.530130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca67e52-37da-4ac3-af10-3b818ffa2ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:02.530409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca67e52-37da-4ac3-af10-3b818ffa2ff5 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:02.531140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca67e52-37da-4ac3-af10-3b818ffa2ff5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:02.531453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca67e52-37da-4ac3-af10-3b818ffa2ff5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:02.533652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca67e52-37da-4ac3-af10-3b818ffa2ff5 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:02.538536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:02.539229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 475/935] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 21:26:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:02.540046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca67e52-37da-4ac3-af10-3b818ffa2ff5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:02.558479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa81590-9e79-4b1c-b3d2-246722ac7539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:02.559127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa81590-9e79-4b1c-b3d2-246722ac7539 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:02.559496 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa81590-9e79-4b1c-b3d2-246722ac7539 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:02.559733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa81590-9e79-4b1c-b3d2-246722ac7539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:02.570983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa81590-9e79-4b1c-b3d2-246722ac7539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:02.572553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa81590-9e79-4b1c-b3d2-246722ac7539 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-6aa81590-9e79-4b1c-b3d2-246722ac7539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:26:02.597023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:02.597951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:02.598910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:26:02.598910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:26:02.598910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:02.598910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:02.598910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 461/936] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:02.598910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa81590-9e79-4b1c-b3d2-246722ac7539 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:02.650670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca67e52-37da-4ac3-af10-3b818ffa2ff5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:02.689392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d8896-a373-4c42-a857-707bb29f720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:02.690456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d8896-a373-4c42-a857-707bb29f720a None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:02.690817 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d8896-a373-4c42-a857-707bb29f720a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:02.691154 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d8896-a373-4c42-a857-707bb29f720a None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:02.692225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d8896-a373-4c42-a857-707bb29f720a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:02.694209 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d8896-a373-4c42-a857-707bb29f720a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:02.696865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: WARNING keystone.server.flask.common [None req-614d8896-a373-4c42-a857-707bb29f720a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 21:26:02.699820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa81590-9e79-4b1c-b3d2-246722ac7539 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:02.734459 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0984c-f916-40cb-8ed4-1ce9792a8cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:02.735068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0984c-f916-40cb-8ed4-1ce9792a8cff None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:02.735351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0984c-f916-40cb-8ed4-1ce9792a8cff None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:02.735640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0984c-f916-40cb-8ed4-1ce9792a8cff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:02.736518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0984c-f916-40cb-8ed4-1ce9792a8cff None admin] RBAC: Adding query filter params (interface=public, service_id=c5a5b730b3f54d358dce3131eabcc9f0, region_id=RegionOne) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:02.736822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0984c-f916-40cb-8ed4-1ce9792a8cff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:02.738161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0984c-f916-40cb-8ed4-1ce9792a8cff None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:02.747532 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 462/937] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 21:26:02 2022] GET /identity/v3/endpoints?service_id=c5a5b730b3f54d358dce3131eabcc9f0&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:02.747679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.sql.core [None req-614d8896-a373-4c42-a857-707bb29f720a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 21:26:02.747679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 21:26:02.747679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [parameters: {'id': '0877b853d5564183bcdce049922ac6db', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 21:26:02.747679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80307) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 21:26:02.748049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0984c-f916-40cb-8ed4-1ce9792a8cff None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:02.751986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-614d8896-a373-4c42-a857-707bb29f720a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0877b853d5564183bcdce049922ac6db.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0877b853d5564183bcdce049922ac6db. Jul 25 21:26:02.751986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:02.751986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 21:26:02.751986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 21:26:02.751986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 21:26:02.751986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 21:26:02.751986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 21:26:02.751986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 21:26:02.751986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 21:26:02.751986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application conn.query(q) Jul 25 21:26:02.751986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 21:26:02.751986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 21:26:02.751986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application result.read() Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 21:26:02.752823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application next(self.gen) Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application yield resource Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application next(self.gen) Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise self.value Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application session.commit() Jul 25 21:26:02.753829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.session.flush() Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application compat.raise_( Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 21:26:02.754711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 21:26:02.755634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application conn.query(q) Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application result.read() Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 21:26:02.758615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [parameters: {'id': '0877b853d5564183bcdce049922ac6db', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:02.760388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:02.761302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:02.762737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:02.762737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 21:26:02.762737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 21:26:02.762737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:02.762737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:02.762737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 21:26:02.762737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 21:26:02.762737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0877b853d5564183bcdce049922ac6db. Jul 25 21:26:02.762737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:02.762737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 476/938] 10.222.0.27 () {60 vars in 1140 bytes} [Mon Jul 25 21:26:02 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:02.762737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d8896-a373-4c42-a857-707bb29f720a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:02.793145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:02.798287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:02.864796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d8896-a373-4c42-a857-707bb29f720a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:02.865611 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0984c-f916-40cb-8ed4-1ce9792a8cff None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:02.901362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebe71d-0ee7-41fe-a8b4-c5a7ee070430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:02.902180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebe71d-0ee7-41fe-a8b4-c5a7ee070430 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:02.902472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebe71d-0ee7-41fe-a8b4-c5a7ee070430 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:02.902834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebe71d-0ee7-41fe-a8b4-c5a7ee070430 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:02.903488 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebe71d-0ee7-41fe-a8b4-c5a7ee070430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:02.903992 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebe71d-0ee7-41fe-a8b4-c5a7ee070430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:02.905129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebe71d-0ee7-41fe-a8b4-c5a7ee070430 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:02.905359 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bbfa8-fcd4-4c17-92a3-c16114c64093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:02.906079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bbfa8-fcd4-4c17-92a3-c16114c64093 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:02.906472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bbfa8-fcd4-4c17-92a3-c16114c64093 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:02.906868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bbfa8-fcd4-4c17-92a3-c16114c64093 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:02.907687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bbfa8-fcd4-4c17-92a3-c16114c64093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:02.909453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bbfa8-fcd4-4c17-92a3-c16114c64093 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:02.921783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 463/939] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:02.921783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebe71d-0ee7-41fe-a8b4-c5a7ee070430 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:02.922060 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 477/940] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 21:26:02 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:26:02.924958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bbfa8-fcd4-4c17-92a3-c16114c64093 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:03.029200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:03.035302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebe71d-0ee7-41fe-a8b4-c5a7ee070430 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:03.053132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:03.056974 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bbfa8-fcd4-4c17-92a3-c16114c64093 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:03.073217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a858ca-357a-4df2-aed7-1e8e5487cb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:03.074290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a858ca-357a-4df2-aed7-1e8e5487cb54 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:03.074290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a858ca-357a-4df2-aed7-1e8e5487cb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:03.074516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a858ca-357a-4df2-aed7-1e8e5487cb54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:03.084106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a858ca-357a-4df2-aed7-1e8e5487cb54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:03.085607 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a858ca-357a-4df2-aed7-1e8e5487cb54 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-86a858ca-357a-4df2-aed7-1e8e5487cb54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:26:03.099477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:03.100629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:03.101733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:26:03.101733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:26:03.101733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:26:03.101733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:26:03.101733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:26:03.101733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:26:03.101733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:26:03.101733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:03.101733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 464/941] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:03.107162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a858ca-357a-4df2-aed7-1e8e5487cb54 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:03.107471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2c283-479d-41d4-9cc1-35a450478ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:03.108170 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c283-479d-41d4-9cc1-35a450478ddd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:03.108457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c283-479d-41d4-9cc1-35a450478ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:03.108736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c283-479d-41d4-9cc1-35a450478ddd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:03.117767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2c283-479d-41d4-9cc1-35a450478ddd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:03.119274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2c283-479d-41d4-9cc1-35a450478ddd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-e0a2c283-479d-41d4-9cc1-35a450478ddd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:26:03.133890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:03.134861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:03.135849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:03.135849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:03.135849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:26:03.135849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:26:03.135849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:26:03.135849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:26:03.135849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:26:03.135849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:26:03.135849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 21:26:03.135849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:03.136409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 478/942] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 21:26:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:03.144691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2c283-479d-41d4-9cc1-35a450478ddd None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:03.248291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a858ca-357a-4df2-aed7-1e8e5487cb54 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:03.263782 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2c283-479d-41d4-9cc1-35a450478ddd None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:03.289105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3354ac-04cc-4d8e-818a-f2011790419e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:03.290238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3354ac-04cc-4d8e-818a-f2011790419e None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:03.290734 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3354ac-04cc-4d8e-818a-f2011790419e None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:03.291194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3354ac-04cc-4d8e-818a-f2011790419e None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:03.292322 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3354ac-04cc-4d8e-818a-f2011790419e None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:03.292696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3354ac-04cc-4d8e-818a-f2011790419e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:03.294190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3354ac-04cc-4d8e-818a-f2011790419e None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:03.305334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c3e93-863e-425e-a67f-6ff00fa723bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:03.306331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c3e93-863e-425e-a67f-6ff00fa723bd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:03.306835 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c3e93-863e-425e-a67f-6ff00fa723bd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:03.307314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c3e93-863e-425e-a67f-6ff00fa723bd None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:03.308363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c3e93-863e-425e-a67f-6ff00fa723bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:03.308894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c3e93-863e-425e-a67f-6ff00fa723bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:03.310538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c3e93-863e-425e-a67f-6ff00fa723bd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:03.315108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 465/943] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 21:26:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:03.330938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 479/944] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 25 21:26:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:03.339795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3354ac-04cc-4d8e-818a-f2011790419e None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:03.361476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:03.457082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3354ac-04cc-4d8e-818a-f2011790419e None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:03.494750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379092b8-520b-4355-a8db-aaac190e1718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:03.495399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379092b8-520b-4355-a8db-aaac190e1718 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:03.495682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379092b8-520b-4355-a8db-aaac190e1718 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:03.495982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379092b8-520b-4355-a8db-aaac190e1718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:03.507300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379092b8-520b-4355-a8db-aaac190e1718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:03.508790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379092b8-520b-4355-a8db-aaac190e1718 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-379092b8-520b-4355-a8db-aaac190e1718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:26:03.524636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:03.525634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:03.526533 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:26:03.526533 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:26:03.526533 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:03.526533 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:03.526533 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 466/945] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:03.531776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c3e93-863e-425e-a67f-6ff00fa723bd None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:03.553044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:03.641111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c3e93-863e-425e-a67f-6ff00fa723bd None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:03.679419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc5865-cbb8-4885-b3a4-0da9e881a4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:03.680139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc5865-cbb8-4885-b3a4-0da9e881a4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:03.680423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc5865-cbb8-4885-b3a4-0da9e881a4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:03.680699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc5865-cbb8-4885-b3a4-0da9e881a4d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:03.681412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc5865-cbb8-4885-b3a4-0da9e881a4d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:03.681719 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc5865-cbb8-4885-b3a4-0da9e881a4d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:03.683101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc5865-cbb8-4885-b3a4-0da9e881a4d8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:03.701205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 480/946] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:03.707227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379092b8-520b-4355-a8db-aaac190e1718 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:03.779159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:03.815923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379092b8-520b-4355-a8db-aaac190e1718 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:03.852543 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d64716-1d9f-4d37-b8c0-b0c5976cbcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:03.853543 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d64716-1d9f-4d37-b8c0-b0c5976cbcdd None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:03.854052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d64716-1d9f-4d37-b8c0-b0c5976cbcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:03.854530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d64716-1d9f-4d37-b8c0-b0c5976cbcdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:03.862102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d64716-1d9f-4d37-b8c0-b0c5976cbcdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:03.863844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d64716-1d9f-4d37-b8c0-b0c5976cbcdd None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-f9d64716-1d9f-4d37-b8c0-b0c5976cbcdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:26:03.875677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:03.877547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:03.878439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:26:03.878439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:26:03.878439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:26:03.878439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:26:03.878439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:26:03.878439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:26:03.878439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:26:03.878439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:03.880858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 467/947] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:26:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:03.888593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d64716-1d9f-4d37-b8c0-b0c5976cbcdd None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:03.889376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ee0b1-aa5f-4227-bd06-2e787df2e00c None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:03.889769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ee0b1-aa5f-4227-bd06-2e787df2e00c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:03.890051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ee0b1-aa5f-4227-bd06-2e787df2e00c None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:03.891446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 481/948] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:03.897591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ae21-85af-4e5a-9516-3f81f06b679a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:03.897887 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ae21-85af-4e5a-9516-3f81f06b679a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:03.898173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538ae21-85af-4e5a-9516-3f81f06b679a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:03.919244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-9538ae21-85af-4e5a-9516-3f81f06b679a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:03.921619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9538ae21-85af-4e5a-9516-3f81f06b679a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:04.001714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 482/949] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:26:04.018458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538ae21-85af-4e5a-9516-3f81f06b679a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:04.019044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d64716-1d9f-4d37-b8c0-b0c5976cbcdd None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:04.029426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:04.056618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:04.069403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaf508-aaa9-4933-a0bd-1c6267d3bee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:04.070515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaf508-aaa9-4933-a0bd-1c6267d3bee8 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:04.070947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaf508-aaa9-4933-a0bd-1c6267d3bee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:04.071552 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eaf508-aaa9-4933-a0bd-1c6267d3bee8 None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:04.072796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaf508-aaa9-4933-a0bd-1c6267d3bee8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:04.073257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaf508-aaa9-4933-a0bd-1c6267d3bee8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:04.074869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eaf508-aaa9-4933-a0bd-1c6267d3bee8 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:04.090002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 468/950] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:26:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:04.096609 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaf508-aaa9-4933-a0bd-1c6267d3bee8 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:04.133922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538ae21-85af-4e5a-9516-3f81f06b679a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:04.172158 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bdb65-f445-451c-8f7f-1fc587cdd30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:04.172819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bdb65-f445-451c-8f7f-1fc587cdd30a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:04.173900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bdb65-f445-451c-8f7f-1fc587cdd30a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:04.174275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bdb65-f445-451c-8f7f-1fc587cdd30a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:04.175308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bdb65-f445-451c-8f7f-1fc587cdd30a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:04.176610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bdb65-f445-451c-8f7f-1fc587cdd30a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-900bdb65-f445-451c-8f7f-1fc587cdd30a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:04.185990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:04.187370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:04.188412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:04.188412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:04.188412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:04.188412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:04.188412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:04.188412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:04.188412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:04.188412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:04.188412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:04.188412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:04.188412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:26:04.188412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:04.188412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:26:04.188412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:04.193111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 483/951] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:26:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:04.193976 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bdb65-f445-451c-8f7f-1fc587cdd30a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:04.234024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eaf508-aaa9-4933-a0bd-1c6267d3bee8 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:04.270768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:04.279977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47656fb-8b4b-4777-8f30-7fb6f4f2b6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:04.280666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47656fb-8b4b-4777-8f30-7fb6f4f2b6b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:04.280950 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47656fb-8b4b-4777-8f30-7fb6f4f2b6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:04.281228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47656fb-8b4b-4777-8f30-7fb6f4f2b6b5 None admin] PATH_INFO: `/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/586e22d3792b4759a38ab4c3bc12cf3b/roles/631665972a484e5cbab7d504f76b20e4` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:04.284063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47656fb-8b4b-4777-8f30-7fb6f4f2b6b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=48d9c81feed744bb9e322910711a0d3b, user_id=586e22d3792b4759a38ab4c3bc12cf3b, role_id=631665972a484e5cbab7d504f76b20e4)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:04.286023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47656fb-8b4b-4777-8f30-7fb6f4f2b6b5 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:04.305049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bdb65-f445-451c-8f7f-1fc587cdd30a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:04.340997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a72a9e-b432-43c8-8045-4658457f4cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:04.341808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72a9e-b432-43c8-8045-4658457f4cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:04.342264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72a9e-b432-43c8-8045-4658457f4cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:04.342690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72a9e-b432-43c8-8045-4658457f4cc0 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:04.343617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a72a9e-b432-43c8-8045-4658457f4cc0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:04.344107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a72a9e-b432-43c8-8045-4658457f4cc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:04.345655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a72a9e-b432-43c8-8045-4658457f4cc0 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:04.355397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 484/952] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 21:26:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:04.356865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a72a9e-b432-43c8-8045-4658457f4cc0 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:04.377831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 469/953] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:26:04 2022] PUT /identity/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/586e22d3792b4759a38ab4c3bc12cf3b/roles/631665972a484e5cbab7d504f76b20e4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:26:04.478816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a72a9e-b432-43c8-8045-4658457f4cc0 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:04.517949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57250697-2997-4bad-8e9b-d525f11a5a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:04.518588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57250697-2997-4bad-8e9b-d525f11a5a1b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:04.518870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57250697-2997-4bad-8e9b-d525f11a5a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:04.519144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57250697-2997-4bad-8e9b-d525f11a5a1b None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:04.519874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57250697-2997-4bad-8e9b-d525f11a5a1b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:04.520184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57250697-2997-4bad-8e9b-d525f11a5a1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:04.521637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57250697-2997-4bad-8e9b-d525f11a5a1b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:04.524066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:04.532055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 485/954] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 21:26:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:05.043377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece9034-9937-4c8d-b14a-a85779d672c1 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:05.043949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece9034-9937-4c8d-b14a-a85779d672c1 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:05.043949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece9034-9937-4c8d-b14a-a85779d672c1 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:05.045551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 470/955] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:05.051411 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1154e-38f6-4e12-9e0f-7ec019f4eadc None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:05.051707 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1154e-38f6-4e12-9e0f-7ec019f4eadc None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:05.052008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1154e-38f6-4e12-9e0f-7ec019f4eadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:05.071239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-41a1154e-38f6-4e12-9e0f-7ec019f4eadc None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:05.072490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-41a1154e-38f6-4e12-9e0f-7ec019f4eadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:05.143661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 486/956] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:05.166236 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece9034-9937-4c8d-b14a-a85779d672c1 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:05.222994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:05.277456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece9034-9937-4c8d-b14a-a85779d672c1 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:05.318481 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9dec1-3d67-49be-8c83-ca489ddb45ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:05.319045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9dec1-3d67-49be-8c83-ca489ddb45ab None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:05.319327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9dec1-3d67-49be-8c83-ca489ddb45ab None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:05.319604 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9dec1-3d67-49be-8c83-ca489ddb45ab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:05.320271 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9dec1-3d67-49be-8c83-ca489ddb45ab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:05.321627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9dec1-3d67-49be-8c83-ca489ddb45ab None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-a3f9dec1-3d67-49be-8c83-ca489ddb45ab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:05.331194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:05.332294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:05.333222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 471/957] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 21:26:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:05.340631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1154e-38f6-4e12-9e0f-7ec019f4eadc None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:05.442219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1154e-38f6-4e12-9e0f-7ec019f4eadc None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:05.472193 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:05.477919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aab72c-cf67-4003-ac0c-70ab68e7763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:05.478621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aab72c-cf67-4003-ac0c-70ab68e7763c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:05.478912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aab72c-cf67-4003-ac0c-70ab68e7763c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:05.479190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aab72c-cf67-4003-ac0c-70ab68e7763c None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:05.479910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aab72c-cf67-4003-ac0c-70ab68e7763c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:05.480222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aab72c-cf67-4003-ac0c-70ab68e7763c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:05.481595 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aab72c-cf67-4003-ac0c-70ab68e7763c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:05.487374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 487/958] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 21:26:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:05.493204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9dec1-3d67-49be-8c83-ca489ddb45ab None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:05.519701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b8f00-1372-40e1-9b5a-b9e6ecb1316d None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:05.520022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b8f00-1372-40e1-9b5a-b9e6ecb1316d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:05.520293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b8f00-1372-40e1-9b5a-b9e6ecb1316d None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:05.521783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 488/959] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:26:05.526714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367588c-5251-4a1a-bb2c-e06ab79fae90 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:05.526997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367588c-5251-4a1a-bb2c-e06ab79fae90 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:05.527298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367588c-5251-4a1a-bb2c-e06ab79fae90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:05.550841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-0367588c-5251-4a1a-bb2c-e06ab79fae90 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:05.552446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0367588c-5251-4a1a-bb2c-e06ab79fae90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:05.613876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9dec1-3d67-49be-8c83-ca489ddb45ab None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:05.635813 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 489/960] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:26:05.647090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:05.651192 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fcc40-2adc-4889-a232-52561e0bb40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:05.651917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fcc40-2adc-4889-a232-52561e0bb40b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:05.652320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fcc40-2adc-4889-a232-52561e0bb40b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:05.652497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fcc40-2adc-4889-a232-52561e0bb40b None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:05.653286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fcc40-2adc-4889-a232-52561e0bb40b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:05.653595 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fcc40-2adc-4889-a232-52561e0bb40b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:05.654457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367588c-5251-4a1a-bb2c-e06ab79fae90 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:05.655035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276fcc40-2adc-4889-a232-52561e0bb40b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:05.662018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 472/961] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 21:26:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:05.667527 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fcc40-2adc-4889-a232-52561e0bb40b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:05.784671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367588c-5251-4a1a-bb2c-e06ab79fae90 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:05.801305 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276fcc40-2adc-4889-a232-52561e0bb40b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:05.812743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:05.824687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be236b-56d0-4b98-87b4-2e1d26b6c9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:05.825310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be236b-56d0-4b98-87b4-2e1d26b6c9c9 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:05.830988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be236b-56d0-4b98-87b4-2e1d26b6c9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:05.830988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be236b-56d0-4b98-87b4-2e1d26b6c9c9 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:05.830988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be236b-56d0-4b98-87b4-2e1d26b6c9c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:05.830988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be236b-56d0-4b98-87b4-2e1d26b6c9c9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:05.845399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f13bd-a6ad-4834-9bef-1beb5b15d4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:05.846382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f13bd-a6ad-4834-9bef-1beb5b15d4af None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:05.846689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f13bd-a6ad-4834-9bef-1beb5b15d4af None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:05.846962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f13bd-a6ad-4834-9bef-1beb5b15d4af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:05.847680 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f13bd-a6ad-4834-9bef-1beb5b15d4af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:05.849076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f13bd-a6ad-4834-9bef-1beb5b15d4af None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:05.863652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.sql.core [None req-51be236b-56d0-4b98-87b4-2e1d26b6c9c9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 21:26:05.863652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 21:26:05.863652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [parameters: {'user_id': 'bd09721f151848248a0d34d8730af086', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 21:26:05.863652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80307) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-51be236b-56d0-4b98-87b4-2e1d26b6c9c9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application conn.query(q) Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application result.read() Jul 25 21:26:05.870878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 21:26:05.872022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application next(self.gen) Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application yield resource Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application next(self.gen) Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise self.value Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application session.commit() Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 21:26:05.873182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.session.flush() Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application compat.raise_( Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 21:26:05.874275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 21:26:05.875509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application conn.query(q) Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application result.read() Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 21:26:05.877179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bd09721f151848248a0d34d8730af086', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:05.878190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 21:26:05.879219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 21:26:05.880637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 21:26:05.880637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 21:26:05.880637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 21:26:05.880637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 21:26:05.880637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 21:26:05.880637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:05.881929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 490/962] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 25 21:26:05 2022] POST /identity/v3/users => generated 160 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:05.886962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be236b-56d0-4b98-87b4-2e1d26b6c9c9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:05.918889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 473/963] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 21:26:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:26:06.011355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be236b-56d0-4b98-87b4-2e1d26b6c9c9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:06.062483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd45dd-7417-4e59-8c36-3b65b6a8a377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:06.063151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd45dd-7417-4e59-8c36-3b65b6a8a377 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:06.063435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd45dd-7417-4e59-8c36-3b65b6a8a377 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:06.064303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd45dd-7417-4e59-8c36-3b65b6a8a377 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:06.073403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd45dd-7417-4e59-8c36-3b65b6a8a377 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:06.074977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd45dd-7417-4e59-8c36-3b65b6a8a377 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-0ffd45dd-7417-4e59-8c36-3b65b6a8a377 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:26:06.088194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:06.089136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:06.090360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:06.090360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:06.090360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:26:06.090360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:26:06.090360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:26:06.090360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:26:06.090360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:26:06.090360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:26:06.090360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 21:26:06.090360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:06.090360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 491/964] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:26:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:06.096437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f13bd-a6ad-4834-9bef-1beb5b15d4af None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:06.130334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:06.206410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f13bd-a6ad-4834-9bef-1beb5b15d4af None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:06.255396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e8377-c4c8-4bfe-b2f0-d7247ebac673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:06.256061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e8377-c4c8-4bfe-b2f0-d7247ebac673 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:06.256349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e8377-c4c8-4bfe-b2f0-d7247ebac673 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:06.256627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e8377-c4c8-4bfe-b2f0-d7247ebac673 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:06.257404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e8377-c4c8-4bfe-b2f0-d7247ebac673 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:06.257714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e8377-c4c8-4bfe-b2f0-d7247ebac673 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:06.259163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e8377-c4c8-4bfe-b2f0-d7247ebac673 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:06.314354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 474/965] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 25 21:26:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:06.589106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce097c9-79d6-4052-9377-5183d4d0a072 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:06.589663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce097c9-79d6-4052-9377-5183d4d0a072 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:06.589663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce097c9-79d6-4052-9377-5183d4d0a072 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:06.591017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 492/966] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:06.597168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f2cca-9211-426a-a05f-72bd01d43b8a None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:06.597453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f2cca-9211-426a-a05f-72bd01d43b8a None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:06.597733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f2cca-9211-426a-a05f-72bd01d43b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:06.626531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-151f2cca-9211-426a-a05f-72bd01d43b8a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:06.626531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-151f2cca-9211-426a-a05f-72bd01d43b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:06.705737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 475/967] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:06.732450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce097c9-79d6-4052-9377-5183d4d0a072 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:06.765743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9783948-e2ed-4a90-93e5-178b2f6a2031 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:06.766065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9783948-e2ed-4a90-93e5-178b2f6a2031 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:06.766308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9783948-e2ed-4a90-93e5-178b2f6a2031 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:06.769952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 476/968] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:06.776302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc01f8-b28d-4e92-a2a7-0c5700de510c None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:06.776892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc01f8-b28d-4e92-a2a7-0c5700de510c None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:06.777391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc01f8-b28d-4e92-a2a7-0c5700de510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:06.797206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:06.802461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-a3dc01f8-b28d-4e92-a2a7-0c5700de510c None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:06.803394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-a3dc01f8-b28d-4e92-a2a7-0c5700de510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:06.820805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:06.870408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce097c9-79d6-4052-9377-5183d4d0a072 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:06.887764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 477/969] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:26:06.899949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc01f8-b28d-4e92-a2a7-0c5700de510c None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:06.906334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b552de0-07dc-4e13-820f-58b39846788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:06.906983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552de0-07dc-4e13-820f-58b39846788c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:06.907866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552de0-07dc-4e13-820f-58b39846788c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:06.908191 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552de0-07dc-4e13-820f-58b39846788c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:06.919439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b552de0-07dc-4e13-820f-58b39846788c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2b552de0-07dc-4e13-820f-58b39846788c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:26:06.925418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:06.926317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:06.927280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:06.927280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:06.927280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:06.927280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:06.927280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:26:06.927280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:26:06.927280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:26:06.927280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:26:06.927280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:26:06.927280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:26:06.927280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 21:26:06.927280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:06.927280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 493/970] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 25 21:26:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:06.932293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b552de0-07dc-4e13-820f-58b39846788c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:07.012151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc01f8-b28d-4e92-a2a7-0c5700de510c None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:07.038896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b552de0-07dc-4e13-820f-58b39846788c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:07.041074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:07.049618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10483d80-6b52-4d6b-ad1e-708428ebfbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:07.050251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10483d80-6b52-4d6b-ad1e-708428ebfbab None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:07.050533 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10483d80-6b52-4d6b-ad1e-708428ebfbab None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:07.050958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10483d80-6b52-4d6b-ad1e-708428ebfbab None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:07.051723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10483d80-6b52-4d6b-ad1e-708428ebfbab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:07.053282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10483d80-6b52-4d6b-ad1e-708428ebfbab None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:07.075934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ff1df-46dd-4799-a14c-4b6bf2f82115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:07.076553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff1df-46dd-4799-a14c-4b6bf2f82115 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:07.076834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff1df-46dd-4799-a14c-4b6bf2f82115 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:07.077109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff1df-46dd-4799-a14c-4b6bf2f82115 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:07.077845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ff1df-46dd-4799-a14c-4b6bf2f82115 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:07.078132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ff1df-46dd-4799-a14c-4b6bf2f82115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:07.079606 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ff1df-46dd-4799-a14c-4b6bf2f82115 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:07.088969 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 494/971] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 25 21:26:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:07.093739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ff1df-46dd-4799-a14c-4b6bf2f82115 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:07.179871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 478/972] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 21:26:06 2022] POST /identity/v3/services => generated 242 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:26:07.202176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ff1df-46dd-4799-a14c-4b6bf2f82115 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:07.247912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbb3f8-9872-4eff-bc83-1ff851d684cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:07.248569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbb3f8-9872-4eff-bc83-1ff851d684cd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:07.248851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbb3f8-9872-4eff-bc83-1ff851d684cd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:07.249123 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbb3f8-9872-4eff-bc83-1ff851d684cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:07.261377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbb3f8-9872-4eff-bc83-1ff851d684cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:07.262853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbb3f8-9872-4eff-bc83-1ff851d684cd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-c9fbb3f8-9872-4eff-bc83-1ff851d684cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:26:07.279088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:07.280349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:07.286945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:26:07.286945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:26:07.286945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:07.286945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:07.286945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 495/973] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:07.287230 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10483d80-6b52-4d6b-ad1e-708428ebfbab None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:07.301871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:07.396931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10483d80-6b52-4d6b-ad1e-708428ebfbab None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:07.432943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762390a8-93aa-4b82-bc83-167c2d7255a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:07.433490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762390a8-93aa-4b82-bc83-167c2d7255a8 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:07.433774 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762390a8-93aa-4b82-bc83-167c2d7255a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:07.434048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762390a8-93aa-4b82-bc83-167c2d7255a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:07.434743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762390a8-93aa-4b82-bc83-167c2d7255a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:07.435048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762390a8-93aa-4b82-bc83-167c2d7255a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:07.436447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762390a8-93aa-4b82-bc83-167c2d7255a8 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:07.452910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 479/974] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:07.454077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbb3f8-9872-4eff-bc83-1ff851d684cd None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:07.470948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:07.558331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbb3f8-9872-4eff-bc83-1ff851d684cd None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:07.593755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e9845-050e-4080-9f55-18615df3c29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:07.594431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e9845-050e-4080-9f55-18615df3c29a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:07.595518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e9845-050e-4080-9f55-18615df3c29a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:07.595723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e9845-050e-4080-9f55-18615df3c29a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:07.603347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e9845-050e-4080-9f55-18615df3c29a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:07.604826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e9845-050e-4080-9f55-18615df3c29a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b20e9845-050e-4080-9f55-18615df3c29a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:26:07.616638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:07.617602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:07.618569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:07.618569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:07.618569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:26:07.618569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:26:07.618569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:26:07.618569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:26:07.618569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:26:07.618569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:26:07.618569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 21:26:07.618569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:07.618569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 496/975] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 21:26:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:07.624935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762390a8-93aa-4b82-bc83-167c2d7255a8 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:07.704962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:07.737153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762390a8-93aa-4b82-bc83-167c2d7255a8 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:07.773453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35449600-8d33-4d48-ab7c-82f82bd33855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:07.774122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35449600-8d33-4d48-ab7c-82f82bd33855 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:07.774400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35449600-8d33-4d48-ab7c-82f82bd33855 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:07.774674 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35449600-8d33-4d48-ab7c-82f82bd33855 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:07.775508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35449600-8d33-4d48-ab7c-82f82bd33855 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:07.775842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35449600-8d33-4d48-ab7c-82f82bd33855 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:07.777245 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35449600-8d33-4d48-ab7c-82f82bd33855 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:07.799305 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 480/976] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 25 21:26:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:07.800951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e9845-050e-4080-9f55-18615df3c29a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:07.874925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:07.905694 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e9845-050e-4080-9f55-18615df3c29a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:07.941874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94604438-6f41-46b4-937d-397b3256a5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:07.942501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94604438-6f41-46b4-937d-397b3256a5ae None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:07.942786 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94604438-6f41-46b4-937d-397b3256a5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:07.943061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94604438-6f41-46b4-937d-397b3256a5ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:08.012460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94604438-6f41-46b4-937d-397b3256a5ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:08.013925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94604438-6f41-46b4-937d-397b3256a5ae None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:08.050259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e3d8-b9b2-4b3a-bbc4-9372d472ecc8 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:08.050553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e3d8-b9b2-4b3a-bbc4-9372d472ecc8 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:08.050819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63e3d8-b9b2-4b3a-bbc4-9372d472ecc8 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:08.052421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 481/977] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:08.057100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591b258-0439-4d50-87c5-c64926b2155b None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:08.057390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591b258-0439-4d50-87c5-c64926b2155b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:08.057686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591b258-0439-4d50-87c5-c64926b2155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:08.076157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-6591b258-0439-4d50-87c5-c64926b2155b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:08.077357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-6591b258-0439-4d50-87c5-c64926b2155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:08.088089 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:08.125094 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 497/978] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:26:07 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:26:08.127056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94604438-6f41-46b4-937d-397b3256a5ae None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:08.155131 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 482/979] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:26:08.177830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591b258-0439-4d50-87c5-c64926b2155b None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:08.238791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94604438-6f41-46b4-937d-397b3256a5ae None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:08.241637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:08.276431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db529d1-1300-49bd-93b4-ef29d18e73b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:08.277308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db529d1-1300-49bd-93b4-ef29d18e73b5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:08.277738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db529d1-1300-49bd-93b4-ef29d18e73b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:08.278012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db529d1-1300-49bd-93b4-ef29d18e73b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:08.286564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591b258-0439-4d50-87c5-c64926b2155b None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:08.288676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db529d1-1300-49bd-93b4-ef29d18e73b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:08.290137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db529d1-1300-49bd-93b4-ef29d18e73b5 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-1db529d1-1300-49bd-93b4-ef29d18e73b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:26:08.305529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:08.306660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:08.307935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:26:08.307935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:26:08.307935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:08.307935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:08.307935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 498/980] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:08.312414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db529d1-1300-49bd-93b4-ef29d18e73b5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:08.326480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17789c51-2e31-4204-a66e-5ccda9be280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:08.327130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17789c51-2e31-4204-a66e-5ccda9be280c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:08.327417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17789c51-2e31-4204-a66e-5ccda9be280c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:08.327694 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17789c51-2e31-4204-a66e-5ccda9be280c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:08.328353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17789c51-2e31-4204-a66e-5ccda9be280c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:08.330484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17789c51-2e31-4204-a66e-5ccda9be280c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-17789c51-2e31-4204-a66e-5ccda9be280c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:08.339563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:08.340666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:08.341511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 483/981] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 21:26:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:08.346711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:08.348725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17789c51-2e31-4204-a66e-5ccda9be280c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:08.427968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db529d1-1300-49bd-93b4-ef29d18e73b5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:08.455515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17789c51-2e31-4204-a66e-5ccda9be280c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:08.465032 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11434e85-40c2-4622-98cf-909cfe0bcf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:08.465654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11434e85-40c2-4622-98cf-909cfe0bcf4a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:08.465938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11434e85-40c2-4622-98cf-909cfe0bcf4a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:08.466213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11434e85-40c2-4622-98cf-909cfe0bcf4a None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:08.467025 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11434e85-40c2-4622-98cf-909cfe0bcf4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:08.467332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11434e85-40c2-4622-98cf-909cfe0bcf4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:08.468731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11434e85-40c2-4622-98cf-909cfe0bcf4a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:08.479214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:08.486377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 499/982] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:08.487405 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11434e85-40c2-4622-98cf-909cfe0bcf4a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:08.495018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93f438-409d-4926-8797-d1c967bc5af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:08.497678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93f438-409d-4926-8797-d1c967bc5af2 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:08.497678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93f438-409d-4926-8797-d1c967bc5af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:08.497678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93f438-409d-4926-8797-d1c967bc5af2 None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:08.497678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93f438-409d-4926-8797-d1c967bc5af2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:08.497678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93f438-409d-4926-8797-d1c967bc5af2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:08.499320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93f438-409d-4926-8797-d1c967bc5af2 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:08.510152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 484/983] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 21:26:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:08.511019 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93f438-409d-4926-8797-d1c967bc5af2 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:08.578986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:08.596537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11434e85-40c2-4622-98cf-909cfe0bcf4a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:08.618869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93f438-409d-4926-8797-d1c967bc5af2 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:08.633836 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f478bb-42c4-4ab0-a7de-b7d1f0caaed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:08.634478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f478bb-42c4-4ab0-a7de-b7d1f0caaed2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:08.634763 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f478bb-42c4-4ab0-a7de-b7d1f0caaed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:08.635036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f478bb-42c4-4ab0-a7de-b7d1f0caaed2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:08.641872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f478bb-42c4-4ab0-a7de-b7d1f0caaed2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:08.643354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f478bb-42c4-4ab0-a7de-b7d1f0caaed2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-79f478bb-42c4-4ab0-a7de-b7d1f0caaed2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:26:08.654555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:08.655456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:08.656388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:26:08.656388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:26:08.656388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:26:08.656388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:26:08.656388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:26:08.656388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:26:08.656388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:26:08.656388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:08.656388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 500/984] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:08.660376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c84176-99fa-43c3-b90a-5202dbda4e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:08.661451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c84176-99fa-43c3-b90a-5202dbda4e16 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:08.661879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c84176-99fa-43c3-b90a-5202dbda4e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:08.662178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f478bb-42c4-4ab0-a7de-b7d1f0caaed2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:08.662445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c84176-99fa-43c3-b90a-5202dbda4e16 None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:08.663263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c84176-99fa-43c3-b90a-5202dbda4e16 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:08.663716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c84176-99fa-43c3-b90a-5202dbda4e16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:08.665545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c84176-99fa-43c3-b90a-5202dbda4e16 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:08.672389 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 485/985] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 21:26:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:08.679377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c84176-99fa-43c3-b90a-5202dbda4e16 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:08.730705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:08.780616 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f478bb-42c4-4ab0-a7de-b7d1f0caaed2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:08.787865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c84176-99fa-43c3-b90a-5202dbda4e16 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:08.817520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da480f19-6bbf-45fd-bcb8-0e0943bcbe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:08.818148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da480f19-6bbf-45fd-bcb8-0e0943bcbe9e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:08.818432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da480f19-6bbf-45fd-bcb8-0e0943bcbe9e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:08.818707 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da480f19-6bbf-45fd-bcb8-0e0943bcbe9e None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:08.819460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da480f19-6bbf-45fd-bcb8-0e0943bcbe9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:08.819793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da480f19-6bbf-45fd-bcb8-0e0943bcbe9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:08.821219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da480f19-6bbf-45fd-bcb8-0e0943bcbe9e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:08.824771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f8d81-2217-49a5-9c00-e39bad434986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:08.825388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f8d81-2217-49a5-9c00-e39bad434986 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:08.825664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f8d81-2217-49a5-9c00-e39bad434986 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:08.825932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f8d81-2217-49a5-9c00-e39bad434986 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:08.826686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f8d81-2217-49a5-9c00-e39bad434986 None admin] RBAC: Adding query filter params (interface=admin, service_id=c5a5b730b3f54d358dce3131eabcc9f0, region_id=RegionOne) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:08.826989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f8d81-2217-49a5-9c00-e39bad434986 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:08.828350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f8d81-2217-49a5-9c00-e39bad434986 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:08.835862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 501/986] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:08.836014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 486/987] 10.222.0.27 () {56 vars in 1249 bytes} [Mon Jul 25 21:26:08 2022] GET /identity/v3/endpoints?service_id=c5a5b730b3f54d358dce3131eabcc9f0&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:08.839631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f8d81-2217-49a5-9c00-e39bad434986 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:08.839782 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da480f19-6bbf-45fd-bcb8-0e0943bcbe9e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:08.845014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:08.946146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da480f19-6bbf-45fd-bcb8-0e0943bcbe9e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:08.946524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f8d81-2217-49a5-9c00-e39bad434986 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:08.960993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:08.981549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93f896-f091-47da-bccb-13d7df035c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:08.982306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93f896-f091-47da-bccb-13d7df035c54 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:08.982794 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93f896-f091-47da-bccb-13d7df035c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:08.983249 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93f896-f091-47da-bccb-13d7df035c54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:08.984329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93f896-f091-47da-bccb-13d7df035c54 None admin] RBAC: Adding query filter params (role.id=631665972a484e5cbab7d504f76b20e4, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=586e22d3792b4759a38ab4c3bc12cf3b) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:08.984643 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93f896-f091-47da-bccb-13d7df035c54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:08.986584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fecbe-e9d9-4e66-9114-92d33688df81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:08.986721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93f896-f091-47da-bccb-13d7df035c54 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:08.987467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fecbe-e9d9-4e66-9114-92d33688df81 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:08.987925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fecbe-e9d9-4e66-9114-92d33688df81 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:08.988355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fecbe-e9d9-4e66-9114-92d33688df81 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:08.989018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fecbe-e9d9-4e66-9114-92d33688df81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:08.990406 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fecbe-e9d9-4e66-9114-92d33688df81 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:08.992997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 487/988] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:26:08 2022] GET /identity/v3/role_assignments?user.id=586e22d3792b4759a38ab4c3bc12cf3b&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=631665972a484e5cbab7d504f76b20e4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:09.004306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 502/989] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 21:26:08 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 21:26:09.263374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefc2df-3afa-435d-8639-e2463376e0a9 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:09.263935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefc2df-3afa-435d-8639-e2463376e0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:09.263935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefc2df-3afa-435d-8639-e2463376e0a9 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:09.265426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 488/990] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:09.270574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe9cc3-926c-4cf3-be70-34026b0b1c29 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:09.270865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe9cc3-926c-4cf3-be70-34026b0b1c29 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:09.271143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe9cc3-926c-4cf3-be70-34026b0b1c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:09.290498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-b0fe9cc3-926c-4cf3-be70-34026b0b1c29 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:09.292044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b0fe9cc3-926c-4cf3-be70-34026b0b1c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:09.357807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:09.364198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 503/991] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:09.386691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefc2df-3afa-435d-8639-e2463376e0a9 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:09.496027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefc2df-3afa-435d-8639-e2463376e0a9 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:09.531054 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691250a3-ea90-4bdd-a5b8-79b4982b7d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:09.531624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691250a3-ea90-4bdd-a5b8-79b4982b7d7d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:09.531938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691250a3-ea90-4bdd-a5b8-79b4982b7d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:09.532892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691250a3-ea90-4bdd-a5b8-79b4982b7d7d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:09.533527 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691250a3-ea90-4bdd-a5b8-79b4982b7d7d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:09.534878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691250a3-ea90-4bdd-a5b8-79b4982b7d7d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-691250a3-ea90-4bdd-a5b8-79b4982b7d7d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:09.544299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:09.545312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:09.546151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:09.546151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:09.546151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:09.546151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:09.546151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:09.546151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:09.546151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:09.546151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:09.546151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:09.546151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:09.546151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:26:09.546151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:09.546151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:26:09.546151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:09.547505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 489/992] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:26:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:09.551878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe9cc3-926c-4cf3-be70-34026b0b1c29 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:09.653652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe9cc3-926c-4cf3-be70-34026b0b1c29 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:09.698727 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63efd57-5b2c-430d-bb97-1d678e63ebdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:09.699363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63efd57-5b2c-430d-bb97-1d678e63ebdc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:09.699645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63efd57-5b2c-430d-bb97-1d678e63ebdc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:09.699939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63efd57-5b2c-430d-bb97-1d678e63ebdc None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:09.700628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63efd57-5b2c-430d-bb97-1d678e63ebdc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:09.700937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63efd57-5b2c-430d-bb97-1d678e63ebdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:09.702462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63efd57-5b2c-430d-bb97-1d678e63ebdc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:09.711134 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 504/993] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 21:26:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:09.714238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691250a3-ea90-4bdd-a5b8-79b4982b7d7d None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:09.761021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:09.818878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691250a3-ea90-4bdd-a5b8-79b4982b7d7d None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:09.853097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164aa2a0-be11-473f-bb05-a2eeb0bd34ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:09.853713 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aa2a0-be11-473f-bb05-a2eeb0bd34ce None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:09.853993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aa2a0-be11-473f-bb05-a2eeb0bd34ce None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:09.854263 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aa2a0-be11-473f-bb05-a2eeb0bd34ce None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:09.854934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164aa2a0-be11-473f-bb05-a2eeb0bd34ce None admin] RBAC: Adding query filter params (type=compute) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:09.855238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164aa2a0-be11-473f-bb05-a2eeb0bd34ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:09.856627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164aa2a0-be11-473f-bb05-a2eeb0bd34ce None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:09.863836 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 490/994] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 21:26:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:09.867641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63efd57-5b2c-430d-bb97-1d678e63ebdc None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:09.929400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:09.969206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63efd57-5b2c-430d-bb97-1d678e63ebdc None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:10.003349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531b45d-9bec-472e-a5aa-177e3cc0c030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:10.004077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b45d-9bec-472e-a5aa-177e3cc0c030 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:10.004426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b45d-9bec-472e-a5aa-177e3cc0c030 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:10.004768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531b45d-9bec-472e-a5aa-177e3cc0c030 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:10.005590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531b45d-9bec-472e-a5aa-177e3cc0c030 None admin] RBAC: Adding query filter params (interface=public, service_id=349b62d9cff14622bc7da9ed41e546f4, region_id=RegionOne) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:10.006025 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531b45d-9bec-472e-a5aa-177e3cc0c030 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:10.007512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531b45d-9bec-472e-a5aa-177e3cc0c030 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:10.017949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 505/995] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 21:26:09 2022] GET /identity/v3/endpoints?service_id=349b62d9cff14622bc7da9ed41e546f4&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:10.019252 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164aa2a0-be11-473f-bb05-a2eeb0bd34ce None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:10.121062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164aa2a0-be11-473f-bb05-a2eeb0bd34ce None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:10.128296 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:10.158571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f93c1-ae5a-4250-994b-df0a7a3a55e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:10.159280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f93c1-ae5a-4250-994b-df0a7a3a55e8 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:10.159501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f93c1-ae5a-4250-994b-df0a7a3a55e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:10.160192 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f93c1-ae5a-4250-994b-df0a7a3a55e8 None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:10.161174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f93c1-ae5a-4250-994b-df0a7a3a55e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:10.163231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f93c1-ae5a-4250-994b-df0a7a3a55e8 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:10.170101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 491/996] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 21:26:10 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:26:11.066315 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704c2d7-ef0b-4244-83c0-cf2410a63f39 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:11.066870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704c2d7-ef0b-4244-83c0-cf2410a63f39 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:11.066870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704c2d7-ef0b-4244-83c0-cf2410a63f39 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:11.071793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 506/997] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:11.073382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e760be-1fa4-41f0-8d7f-8555a706c09b None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:11.073763 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e760be-1fa4-41f0-8d7f-8555a706c09b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:11.073953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e760be-1fa4-41f0-8d7f-8555a706c09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:11.092431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-a5e760be-1fa4-41f0-8d7f-8555a706c09b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:11.093621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-a5e760be-1fa4-41f0-8d7f-8555a706c09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:11.108908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a04de-674c-4a29-ba0a-a12d4a09686b None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:11.109183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a04de-674c-4a29-ba0a-a12d4a09686b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:11.109459 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a04de-674c-4a29-ba0a-a12d4a09686b None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:11.111598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 507/998] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:26:11.116411 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a1da-8f10-40e2-ae2a-1caddbb01d56 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:11.116698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a1da-8f10-40e2-ae2a-1caddbb01d56 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:11.117002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48a1da-8f10-40e2-ae2a-1caddbb01d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:11.135057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-bb48a1da-8f10-40e2-ae2a-1caddbb01d56 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:11.136267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-bb48a1da-8f10-40e2-ae2a-1caddbb01d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:11.163890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 492/999] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:11.186168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e760be-1fa4-41f0-8d7f-8555a706c09b None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:11.210915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 508/1000] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:26:11.232353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48a1da-8f10-40e2-ae2a-1caddbb01d56 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:11.290199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:11.299702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:11.303768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e760be-1fa4-41f0-8d7f-8555a706c09b None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:11.335546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48a1da-8f10-40e2-ae2a-1caddbb01d56 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:11.338693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9e12f-cdae-4c03-95c4-f33a9fa0455e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:11.339341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9e12f-cdae-4c03-95c4-f33a9fa0455e None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:11.339627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9e12f-cdae-4c03-95c4-f33a9fa0455e None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:11.339935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9e12f-cdae-4c03-95c4-f33a9fa0455e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:11.340566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9e12f-cdae-4c03-95c4-f33a9fa0455e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:11.341928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9e12f-cdae-4c03-95c4-f33a9fa0455e None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-9bc9e12f-cdae-4c03-95c4-f33a9fa0455e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:11.353270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:11.361570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:11.362498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 493/1001] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 25 21:26:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:11.363558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9e12f-cdae-4c03-95c4-f33a9fa0455e None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:11.376507 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837ff95-ddf0-4118-b7d6-f1b05144dd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:11.377447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ff95-ddf0-4118-b7d6-f1b05144dd66 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:11.377447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ff95-ddf0-4118-b7d6-f1b05144dd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:11.377731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ff95-ddf0-4118-b7d6-f1b05144dd66 None admin] PATH_INFO: `/v3/services/image` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:11.378369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837ff95-ddf0-4118-b7d6-f1b05144dd66 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:11.379776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837ff95-ddf0-4118-b7d6-f1b05144dd66 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-5837ff95-ddf0-4118-b7d6-f1b05144dd66 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:11.388593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:11.389793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:11.390641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 509/1002] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Jul 25 21:26:11 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:11.395837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837ff95-ddf0-4118-b7d6-f1b05144dd66 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:11.480360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9e12f-cdae-4c03-95c4-f33a9fa0455e None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:11.499124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837ff95-ddf0-4118-b7d6-f1b05144dd66 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:11.514701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ac22e-51e4-47ad-afb9-bfaf7fc49e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:11.515323 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ac22e-51e4-47ad-afb9-bfaf7fc49e6d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:11.515608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ac22e-51e4-47ad-afb9-bfaf7fc49e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:11.515938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ac22e-51e4-47ad-afb9-bfaf7fc49e6d None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:11.516690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ac22e-51e4-47ad-afb9-bfaf7fc49e6d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:11.516966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ac22e-51e4-47ad-afb9-bfaf7fc49e6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:11.518319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ac22e-51e4-47ad-afb9-bfaf7fc49e6d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:11.520475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:11.523286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 494/1003] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 21:26:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:11.528904 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ac22e-51e4-47ad-afb9-bfaf7fc49e6d None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:11.535536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3267ac-1a8e-4a96-9949-91e71493aa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:11.536561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3267ac-1a8e-4a96-9949-91e71493aa15 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:11.536924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3267ac-1a8e-4a96-9949-91e71493aa15 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:11.537267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3267ac-1a8e-4a96-9949-91e71493aa15 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:11.538018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3267ac-1a8e-4a96-9949-91e71493aa15 None admin] RBAC: Adding query filter params (name=image) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:11.538396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3267ac-1a8e-4a96-9949-91e71493aa15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:11.539864 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3267ac-1a8e-4a96-9949-91e71493aa15 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:11.545691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 510/1004] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:11.551854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3267ac-1a8e-4a96-9949-91e71493aa15 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:11.564755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:11.638255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ac22e-51e4-47ad-afb9-bfaf7fc49e6d None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:11.660843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3267ac-1a8e-4a96-9949-91e71493aa15 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:11.679653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6098b6-d5d9-4fd8-9c16-72e3bafc8331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:11.680311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6098b6-d5d9-4fd8-9c16-72e3bafc8331 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:11.680594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6098b6-d5d9-4fd8-9c16-72e3bafc8331 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:11.680869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6098b6-d5d9-4fd8-9c16-72e3bafc8331 None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:11.681548 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6098b6-d5d9-4fd8-9c16-72e3bafc8331 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:11.681863 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6098b6-d5d9-4fd8-9c16-72e3bafc8331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:11.683217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6098b6-d5d9-4fd8-9c16-72e3bafc8331 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:11.694097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 495/1005] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 25 21:26:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:11.694757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6098b6-d5d9-4fd8-9c16-72e3bafc8331 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:11.711122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357d354-c757-4f9b-b8db-42d40e09cd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:11.711776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357d354-c757-4f9b-b8db-42d40e09cd13 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:11.712197 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357d354-c757-4f9b-b8db-42d40e09cd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:11.712476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357d354-c757-4f9b-b8db-42d40e09cd13 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:11.713164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357d354-c757-4f9b-b8db-42d40e09cd13 None admin] RBAC: Adding query filter params (type=image) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:11.713472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357d354-c757-4f9b-b8db-42d40e09cd13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:11.714846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357d354-c757-4f9b-b8db-42d40e09cd13 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:11.719299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 511/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:11.807102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:11.817195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6098b6-d5d9-4fd8-9c16-72e3bafc8331 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:11.855711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b67c9c-069d-46c9-949a-b91380038455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:11.856372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b67c9c-069d-46c9-949a-b91380038455 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:11.856652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b67c9c-069d-46c9-949a-b91380038455 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:11.856928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b67c9c-069d-46c9-949a-b91380038455 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:11.857646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b67c9c-069d-46c9-949a-b91380038455 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:11.859037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b67c9c-069d-46c9-949a-b91380038455 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:11.932751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 496/1007] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 21:26:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:26:12.219521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ed342-b701-4e19-9a16-04364f26c326 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:12.220112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ed342-b701-4e19-9a16-04364f26c326 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:12.220112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ed342-b701-4e19-9a16-04364f26c326 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:12.221612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 512/1008] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:12.226663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e41fc-1150-45be-8cc2-38c7f93678d2 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:12.227049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e41fc-1150-45be-8cc2-38c7f93678d2 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:12.227228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e41fc-1150-45be-8cc2-38c7f93678d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:12.245838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-4d7e41fc-1150-45be-8cc2-38c7f93678d2 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:12.247031 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-4d7e41fc-1150-45be-8cc2-38c7f93678d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:12.322049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 497/1009] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:12.344840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ed342-b701-4e19-9a16-04364f26c326 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:12.396865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:12.452400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ed342-b701-4e19-9a16-04364f26c326 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:12.487598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909d71a-1976-4f7f-9c31-4b6301e3e96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:12.488211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909d71a-1976-4f7f-9c31-4b6301e3e96a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:12.488489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909d71a-1976-4f7f-9c31-4b6301e3e96a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:12.488757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909d71a-1976-4f7f-9c31-4b6301e3e96a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:12.489382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909d71a-1976-4f7f-9c31-4b6301e3e96a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:12.490739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909d71a-1976-4f7f-9c31-4b6301e3e96a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-9909d71a-1976-4f7f-9c31-4b6301e3e96a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:12.500664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:12.502372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:12.503228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 513/1010] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:26:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:12.507337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e41fc-1150-45be-8cc2-38c7f93678d2 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:12.587567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:12.610104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e41fc-1150-45be-8cc2-38c7f93678d2 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:12.645213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a741d-f637-4dee-9adb-d7124b237a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:12.645841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a741d-f637-4dee-9adb-d7124b237a9d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:12.646127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a741d-f637-4dee-9adb-d7124b237a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:12.646404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a741d-f637-4dee-9adb-d7124b237a9d None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:12.647093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a741d-f637-4dee-9adb-d7124b237a9d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:12.647403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a741d-f637-4dee-9adb-d7124b237a9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:12.648809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a741d-f637-4dee-9adb-d7124b237a9d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:12.653980 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 498/1011] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 21:26:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:12.660001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909d71a-1976-4f7f-9c31-4b6301e3e96a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:12.780254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909d71a-1976-4f7f-9c31-4b6301e3e96a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:12.794207 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:12.816286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d5c22-8071-4ff6-984a-0f4887d8ff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:12.816994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d5c22-8071-4ff6-984a-0f4887d8ff9a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:12.817272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d5c22-8071-4ff6-984a-0f4887d8ff9a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:12.817543 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d5c22-8071-4ff6-984a-0f4887d8ff9a None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:12.818218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d5c22-8071-4ff6-984a-0f4887d8ff9a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:12.818522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d5c22-8071-4ff6-984a-0f4887d8ff9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:12.819912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d5c22-8071-4ff6-984a-0f4887d8ff9a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:12.830722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 514/1012] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 25 21:26:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:12.831670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a741d-f637-4dee-9adb-d7124b237a9d None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:12.932680 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a741d-f637-4dee-9adb-d7124b237a9d None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:12.966908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bd48f-b789-4781-a066-5bdaaf078525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:12.967529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd48f-b789-4781-a066-5bdaaf078525 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:12.967843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd48f-b789-4781-a066-5bdaaf078525 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:12.968130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd48f-b789-4781-a066-5bdaaf078525 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:12.968845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bd48f-b789-4781-a066-5bdaaf078525 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:12.970499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bd48f-b789-4781-a066-5bdaaf078525 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:13.041471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:13.055779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 499/1013] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 21:26:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:26:13.753319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e052-8846-4948-a743-81c8dc5b44f8 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:13.753861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e052-8846-4948-a743-81c8dc5b44f8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:13.753861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e052-8846-4948-a743-81c8dc5b44f8 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:13.755372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 515/1014] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:13.760443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5840f93-64be-47b7-9941-519fe5b6dd24 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:13.760840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5840f93-64be-47b7-9941-519fe5b6dd24 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:13.761059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5840f93-64be-47b7-9941-519fe5b6dd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:13.779724 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-f5840f93-64be-47b7-9941-519fe5b6dd24 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:13.780943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-f5840f93-64be-47b7-9941-519fe5b6dd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:13.853115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 500/1015] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:13 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:13.876446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494e052-8846-4948-a743-81c8dc5b44f8 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:13.983390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494e052-8846-4948-a743-81c8dc5b44f8 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:14.018482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a25fe-ca4a-41e6-bf8d-f012c8f4e314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:14.019117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a25fe-ca4a-41e6-bf8d-f012c8f4e314 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:14.019417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a25fe-ca4a-41e6-bf8d-f012c8f4e314 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:14.019682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a25fe-ca4a-41e6-bf8d-f012c8f4e314 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:14.020423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a25fe-ca4a-41e6-bf8d-f012c8f4e314 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:14.021809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a25fe-ca4a-41e6-bf8d-f012c8f4e314 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:14.028529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cd698-20f1-46f3-aa28-c3594c8aa7d6 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:14.028822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cd698-20f1-46f3-aa28-c3594c8aa7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:14.029099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cd698-20f1-46f3-aa28-c3594c8aa7d6 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:14.030419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 501/1016] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:26:14.036572 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2e1fc-5f00-4c7e-ac5c-ea9858db6ab0 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:14.045573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2e1fc-5f00-4c7e-ac5c-ea9858db6ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:14.045573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2e1fc-5f00-4c7e-ac5c-ea9858db6ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:14.055939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-82e2e1fc-5f00-4c7e-ac5c-ea9858db6ab0 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:14.057252 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-82e2e1fc-5f00-4c7e-ac5c-ea9858db6ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:14.121571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 516/1017] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 21:26:13 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:26:14.138565 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 502/1018] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:26:14.164588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a25fe-ca4a-41e6-bf8d-f012c8f4e314 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:14.213328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:14.296429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a25fe-ca4a-41e6-bf8d-f012c8f4e314 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:14.335120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6986f-cdbf-48ea-9445-d9f55d8c16dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:14.335789 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6986f-cdbf-48ea-9445-d9f55d8c16dc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:14.336076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6986f-cdbf-48ea-9445-d9f55d8c16dc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:14.336348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6986f-cdbf-48ea-9445-d9f55d8c16dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:14.337504 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6986f-cdbf-48ea-9445-d9f55d8c16dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:14.338930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6986f-cdbf-48ea-9445-d9f55d8c16dc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:14.340707 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 517/1019] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:14.347330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2e1fc-5f00-4c7e-ac5c-ea9858db6ab0 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:14.397574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:14.450393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2e1fc-5f00-4c7e-ac5c-ea9858db6ab0 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:14.484389 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18417ea8-6c1b-4144-a1f1-498298c0fc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:14.485038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18417ea8-6c1b-4144-a1f1-498298c0fc47 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:14.485836 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18417ea8-6c1b-4144-a1f1-498298c0fc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:14.486110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18417ea8-6c1b-4144-a1f1-498298c0fc47 None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:14.486805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18417ea8-6c1b-4144-a1f1-498298c0fc47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:14.488268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18417ea8-6c1b-4144-a1f1-498298c0fc47 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:14.573390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 503/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 21:26:14 2022] POST /identity/v3/projects => generated 311 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:26:15.195452 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45755ca8-1449-45ca-b82c-97e95404f412 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:15.196005 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45755ca8-1449-45ca-b82c-97e95404f412 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:15.196005 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45755ca8-1449-45ca-b82c-97e95404f412 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:15.197523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 518/1021] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:15.202556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975dfa4-73a6-4c55-ae1f-c07bb6a2e646 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:15.203002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975dfa4-73a6-4c55-ae1f-c07bb6a2e646 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:15.203148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975dfa4-73a6-4c55-ae1f-c07bb6a2e646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:15.222178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-3975dfa4-73a6-4c55-ae1f-c07bb6a2e646 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:15.223376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-3975dfa4-73a6-4c55-ae1f-c07bb6a2e646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:15.295695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 504/1022] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:15.318885 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45755ca8-1449-45ca-b82c-97e95404f412 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:15.420755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45755ca8-1449-45ca-b82c-97e95404f412 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:15.423659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:15.455310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417a0e1-85d3-49ee-95a4-130728dc4b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:15.455929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417a0e1-85d3-49ee-95a4-130728dc4b30 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:15.456211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417a0e1-85d3-49ee-95a4-130728dc4b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:15.456484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417a0e1-85d3-49ee-95a4-130728dc4b30 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:15.467003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417a0e1-85d3-49ee-95a4-130728dc4b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-a417a0e1-85d3-49ee-95a4-130728dc4b30 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:26:15.472549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:15.473473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:15.474302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:15.474302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:15.474302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:15.474302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:15.474302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:26:15.474302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:26:15.474302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:26:15.474302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:26:15.474302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:26:15.474302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:26:15.474302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 21:26:15.474302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:15.475565 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 519/1023] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 25 21:26:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:15.479635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975dfa4-73a6-4c55-ae1f-c07bb6a2e646 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:15.509527 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:15.579877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975dfa4-73a6-4c55-ae1f-c07bb6a2e646 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:15.614617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb5451-45f0-4f5d-83c2-4a4a02e62bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:15.615311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb5451-45f0-4f5d-83c2-4a4a02e62bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:15.615596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb5451-45f0-4f5d-83c2-4a4a02e62bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:15.615902 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb5451-45f0-4f5d-83c2-4a4a02e62bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:15.616622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb5451-45f0-4f5d-83c2-4a4a02e62bf4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:15.616929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb5451-45f0-4f5d-83c2-4a4a02e62bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:15.618337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb5451-45f0-4f5d-83c2-4a4a02e62bf4 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:15.626627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 505/1024] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 25 21:26:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:15.632125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417a0e1-85d3-49ee-95a4-130728dc4b30 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:15.747971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417a0e1-85d3-49ee-95a4-130728dc4b30 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:15.782546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83c32f-bf9d-4ec1-9c22-29ccb5e14d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:15.783511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83c32f-bf9d-4ec1-9c22-29ccb5e14d6b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:15.784016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83c32f-bf9d-4ec1-9c22-29ccb5e14d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:15.784473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83c32f-bf9d-4ec1-9c22-29ccb5e14d6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:15.795636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83c32f-bf9d-4ec1-9c22-29ccb5e14d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:15.797360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83c32f-bf9d-4ec1-9c22-29ccb5e14d6b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-7a83c32f-bf9d-4ec1-9c22-29ccb5e14d6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:26:15.812421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:15.814018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:15.815112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:26:15.815112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:26:15.815112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:15.815112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:15.816615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 520/1025] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:15.822278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb5451-45f0-4f5d-83c2-4a4a02e62bf4 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:15.917023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:15.924771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb5451-45f0-4f5d-83c2-4a4a02e62bf4 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:15.958495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1ec75-4de5-4be1-89f3-328a84bdb08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:15.959117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1ec75-4de5-4be1-89f3-328a84bdb08b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:15.959396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1ec75-4de5-4be1-89f3-328a84bdb08b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:15.959667 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1ec75-4de5-4be1-89f3-328a84bdb08b None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:15.960386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1ec75-4de5-4be1-89f3-328a84bdb08b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:15.960692 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1ec75-4de5-4be1-89f3-328a84bdb08b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:15.962040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1ec75-4de5-4be1-89f3-328a84bdb08b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:15.978114 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 506/1026] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:15.979254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83c32f-bf9d-4ec1-9c22-29ccb5e14d6b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:15.998979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:16.083298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83c32f-bf9d-4ec1-9c22-29ccb5e14d6b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:16.118584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1767973-dee9-4c56-8d8b-898995f7de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:16.119229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1767973-dee9-4c56-8d8b-898995f7de63 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:16.119511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1767973-dee9-4c56-8d8b-898995f7de63 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:16.119860 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1767973-dee9-4c56-8d8b-898995f7de63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:16.127394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1767973-dee9-4c56-8d8b-898995f7de63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:16.128879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1767973-dee9-4c56-8d8b-898995f7de63 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-c1767973-dee9-4c56-8d8b-898995f7de63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:26:16.140619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:16.141761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:16.149240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:16.149240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:16.149240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:26:16.149240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:26:16.149240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:26:16.149240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:26:16.149240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:26:16.149240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:26:16.149240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:26:16.149240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:16.149240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 521/1027] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 21:26:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:16.150050 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1ec75-4de5-4be1-89f3-328a84bdb08b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:16.170337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0344c30-22c8-4def-9b85-d786c153fdfa None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:16.170626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0344c30-22c8-4def-9b85-d786c153fdfa None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:16.170908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0344c30-22c8-4def-9b85-d786c153fdfa None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:16.172303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 522/1028] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:16.177837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30629643-bb07-4036-84f3-6e11963751ed None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:16.178129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30629643-bb07-4036-84f3-6e11963751ed None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:16.178414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30629643-bb07-4036-84f3-6e11963751ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:16.196307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-30629643-bb07-4036-84f3-6e11963751ed None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:16.197500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-30629643-bb07-4036-84f3-6e11963751ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:16.259866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1ec75-4de5-4be1-89f3-328a84bdb08b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:16.272025 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 523/1029] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:26:16.295426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30629643-bb07-4036-84f3-6e11963751ed None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:16.297273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5fb3d-f00a-4038-bb66-75a20e605250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:16.298416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5fb3d-f00a-4038-bb66-75a20e605250 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:16.298842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5fb3d-f00a-4038-bb66-75a20e605250 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:16.299123 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5fb3d-f00a-4038-bb66-75a20e605250 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:16.299957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5fb3d-f00a-4038-bb66-75a20e605250 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:16.300270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5fb3d-f00a-4038-bb66-75a20e605250 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:16.301689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5fb3d-f00a-4038-bb66-75a20e605250 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:16.305271 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:16.321166 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 507/1030] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 21:26:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:16.327654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5fb3d-f00a-4038-bb66-75a20e605250 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:16.343287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:16.408044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30629643-bb07-4036-84f3-6e11963751ed None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:16.435299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5fb3d-f00a-4038-bb66-75a20e605250 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:16.446267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d5d46-a3be-4d90-a5d5-fbce1cb0e2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:16.446918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d5d46-a3be-4d90-a5d5-fbce1cb0e2ad None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:16.447203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d5d46-a3be-4d90-a5d5-fbce1cb0e2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:16.447481 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d5d46-a3be-4d90-a5d5-fbce1cb0e2ad None admin] PATH_INFO: `/v3/services/image` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:16.448158 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d5d46-a3be-4d90-a5d5-fbce1cb0e2ad None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:16.449644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d5d46-a3be-4d90-a5d5-fbce1cb0e2ad None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-de3d5d46-a3be-4d90-a5d5-fbce1cb0e2ad None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:16.459917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:16.460908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:16.461743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 524/1031] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Jul 25 21:26:16 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:16.466936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d5d46-a3be-4d90-a5d5-fbce1cb0e2ad None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:16.473283 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54f382-00e2-4637-b94e-70d19dae1399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:16.473907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54f382-00e2-4637-b94e-70d19dae1399 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:16.474194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54f382-00e2-4637-b94e-70d19dae1399 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:16.474466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54f382-00e2-4637-b94e-70d19dae1399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:16.542532 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:16.544893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54f382-00e2-4637-b94e-70d19dae1399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:16.546347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54f382-00e2-4637-b94e-70d19dae1399 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:16.561109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:16.578393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d5d46-a3be-4d90-a5d5-fbce1cb0e2ad None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:16.618809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825240e4-ca43-4bcb-b973-0878cfcda0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:16.619931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825240e4-ca43-4bcb-b973-0878cfcda0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:16.620220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825240e4-ca43-4bcb-b973-0878cfcda0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:16.620493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825240e4-ca43-4bcb-b973-0878cfcda0a8 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:16.621328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825240e4-ca43-4bcb-b973-0878cfcda0a8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:16.621632 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825240e4-ca43-4bcb-b973-0878cfcda0a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:16.623153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825240e4-ca43-4bcb-b973-0878cfcda0a8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:16.629174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 525/1032] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:16.634452 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825240e4-ca43-4bcb-b973-0878cfcda0a8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:16.658710 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 508/1033] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:26:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:26:16.659883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25f09-c801-4cd4-96e7-7a9a88db5c31 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:16.660178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25f09-c801-4cd4-96e7-7a9a88db5c31 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:16.660459 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd25f09-c801-4cd4-96e7-7a9a88db5c31 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:16.662081 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 509/1034] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:16.664666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd25f09-c801-4cd4-96e7-7a9a88db5c31 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:16.738083 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825240e4-ca43-4bcb-b973-0878cfcda0a8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:16.770172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd25f09-c801-4cd4-96e7-7a9a88db5c31 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:16.771558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0df9b-e35a-47c4-aab5-7ac1c2d26e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:16.772224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0df9b-e35a-47c4-aab5-7ac1c2d26e16 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:16.772509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0df9b-e35a-47c4-aab5-7ac1c2d26e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:16.772784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0df9b-e35a-47c4-aab5-7ac1c2d26e16 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:16.773466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0df9b-e35a-47c4-aab5-7ac1c2d26e16 None admin] RBAC: Adding query filter params (type=image) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:16.773775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0df9b-e35a-47c4-aab5-7ac1c2d26e16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:16.775149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0df9b-e35a-47c4-aab5-7ac1c2d26e16 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:16.776449 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:16.780980 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 526/1035] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:16.782394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c738245-68cd-4b96-aa9f-cf04b5b88475 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:16.782685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c738245-68cd-4b96-aa9f-cf04b5b88475 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:16.782961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c738245-68cd-4b96-aa9f-cf04b5b88475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:16.783978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:16.800977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-7c738245-68cd-4b96-aa9f-cf04b5b88475 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:16.802103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7c738245-68cd-4b96-aa9f-cf04b5b88475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:16.805296 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163821c-a303-40dc-9ea7-bbf1da6783d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:16.805929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163821c-a303-40dc-9ea7-bbf1da6783d5 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:16.806205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163821c-a303-40dc-9ea7-bbf1da6783d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:16.806474 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163821c-a303-40dc-9ea7-bbf1da6783d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:16.817836 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163821c-a303-40dc-9ea7-bbf1da6783d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:16.819691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163821c-a303-40dc-9ea7-bbf1da6783d5 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-2163821c-a303-40dc-9ea7-bbf1da6783d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:26:16.835285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:16.841672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:16.842583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:26:16.842583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:26:16.842583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:16.842583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:16.842583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 510/1036] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:16.842583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163821c-a303-40dc-9ea7-bbf1da6783d5 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:16.873990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 527/1037] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:16.874829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c738245-68cd-4b96-aa9f-cf04b5b88475 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:16.942716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163821c-a303-40dc-9ea7-bbf1da6783d5 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:16.975462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c738245-68cd-4b96-aa9f-cf04b5b88475 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:16.976122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fee1d-9280-40c6-a2f5-7d133cd86142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:16.976743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fee1d-9280-40c6-a2f5-7d133cd86142 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:16.977028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fee1d-9280-40c6-a2f5-7d133cd86142 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:16.977300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fee1d-9280-40c6-a2f5-7d133cd86142 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:16.978057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fee1d-9280-40c6-a2f5-7d133cd86142 None admin] RBAC: Adding query filter params (interface=public, service_id=88cc22ae85e44ced972df3f852b835ab, region_id=RegionOne) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:16.978373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fee1d-9280-40c6-a2f5-7d133cd86142 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:16.979718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fee1d-9280-40c6-a2f5-7d133cd86142 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:16.984727 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 511/1038] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 21:26:16 2022] GET /identity/v3/endpoints?service_id=88cc22ae85e44ced972df3f852b835ab&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:16.987473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fee1d-9280-40c6-a2f5-7d133cd86142 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:17.003024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:17.010648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0a076-1d99-4c57-85d2-43c267e12d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:17.011297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0a076-1d99-4c57-85d2-43c267e12d63 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:17.013795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0a076-1d99-4c57-85d2-43c267e12d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:17.013795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0a076-1d99-4c57-85d2-43c267e12d63 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:17.013795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0a076-1d99-4c57-85d2-43c267e12d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:17.013795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0a076-1d99-4c57-85d2-43c267e12d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:17.014257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0a076-1d99-4c57-85d2-43c267e12d63 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:17.016710 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:17.025527 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 528/1039] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:17.026334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0a076-1d99-4c57-85d2-43c267e12d63 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:17.093492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fee1d-9280-40c6-a2f5-7d133cd86142 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:17.129047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ea84e-5277-417e-8c2b-2f45c0b94cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:17.129689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ea84e-5277-417e-8c2b-2f45c0b94cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:17.129965 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ea84e-5277-417e-8c2b-2f45c0b94cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:17.130238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ea84e-5277-417e-8c2b-2f45c0b94cb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:17.131391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ea84e-5277-417e-8c2b-2f45c0b94cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:17.131494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0a076-1d99-4c57-85d2-43c267e12d63 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:17.132846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ea84e-5277-417e-8c2b-2f45c0b94cb2 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:17.134426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 512/1040] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:17.135178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ea84e-5277-417e-8c2b-2f45c0b94cb2 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:17.167045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf3855-a652-48ab-979a-6171046b7bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:17.167664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf3855-a652-48ab-979a-6171046b7bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:17.167975 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf3855-a652-48ab-979a-6171046b7bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:17.168253 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf3855-a652-48ab-979a-6171046b7bc9 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:17.168913 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf3855-a652-48ab-979a-6171046b7bc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:17.170284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf3855-a652-48ab-979a-6171046b7bc9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:17.177346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 529/1041] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 21:26:17 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:26:17.178186 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf3855-a652-48ab-979a-6171046b7bc9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:17.240189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:17.248413 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:17.255376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ea84e-5277-417e-8c2b-2f45c0b94cb2 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:17.294283 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf3855-a652-48ab-979a-6171046b7bc9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:17.294718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe8fc9-e8c8-4de7-b1c4-49b4a15ef823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:17.295382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe8fc9-e8c8-4de7-b1c4-49b4a15ef823 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:17.295664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe8fc9-e8c8-4de7-b1c4-49b4a15ef823 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:17.296031 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe8fc9-e8c8-4de7-b1c4-49b4a15ef823 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:17.305941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe8fc9-e8c8-4de7-b1c4-49b4a15ef823 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:17.307812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe8fc9-e8c8-4de7-b1c4-49b4a15ef823 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-9afe8fc9-e8c8-4de7-b1c4-49b4a15ef823 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:26:17.321510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:17.322567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:17.323495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:26:17.323495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:26:17.323495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:26:17.323495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:26:17.323495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:26:17.323495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:26:17.323495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:26:17.323495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:17.323495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 513/1042] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:26:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:17.329765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe8fc9-e8c8-4de7-b1c4-49b4a15ef823 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:17.339256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e96f8-3da6-4734-b2f3-8127f9abd3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:17.339920 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e96f8-3da6-4734-b2f3-8127f9abd3e9 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:17.340205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e96f8-3da6-4734-b2f3-8127f9abd3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:17.340482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e96f8-3da6-4734-b2f3-8127f9abd3e9 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:17.341176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e96f8-3da6-4734-b2f3-8127f9abd3e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:17.342612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e96f8-3da6-4734-b2f3-8127f9abd3e9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:17.432399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 530/1043] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:26:17 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:26:17.436050 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe8fc9-e8c8-4de7-b1c4-49b4a15ef823 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:17.475926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c92f8b-6ea1-484f-82ee-55c1ef046bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:17.476573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c92f8b-6ea1-484f-82ee-55c1ef046bfa None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:17.476858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c92f8b-6ea1-484f-82ee-55c1ef046bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:17.477132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c92f8b-6ea1-484f-82ee-55c1ef046bfa None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:17.477910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c92f8b-6ea1-484f-82ee-55c1ef046bfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:17.478220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c92f8b-6ea1-484f-82ee-55c1ef046bfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:17.479820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c92f8b-6ea1-484f-82ee-55c1ef046bfa None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:17.493161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 514/1044] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:17.499153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e96f8-3da6-4734-b2f3-8127f9abd3e9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:17.609168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e96f8-3da6-4734-b2f3-8127f9abd3e9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:17.619011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:17.648106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0236aa-3773-40a8-96bf-6000038d470e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:17.648726 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0236aa-3773-40a8-96bf-6000038d470e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:17.649009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0236aa-3773-40a8-96bf-6000038d470e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:17.649283 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0236aa-3773-40a8-96bf-6000038d470e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:17.650084 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0236aa-3773-40a8-96bf-6000038d470e None admin] RBAC: Adding query filter params (role.id=631665972a484e5cbab7d504f76b20e4, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=7d3d6613476c445b82302df5025f3ce6) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:17.650399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0236aa-3773-40a8-96bf-6000038d470e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:17.651967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0236aa-3773-40a8-96bf-6000038d470e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:17.658733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 531/1045] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:26:17 2022] GET /identity/v3/role_assignments?user.id=7d3d6613476c445b82302df5025f3ce6&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=631665972a484e5cbab7d504f76b20e4 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:19.217500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7c096-bdc4-4373-9cb0-f712e578e8a4 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:19.218091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7c096-bdc4-4373-9cb0-f712e578e8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:19.218091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7c096-bdc4-4373-9cb0-f712e578e8a4 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:19.220326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 515/1046] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:19.225459 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e920f5-6bc5-4aa6-af5a-7592ab6b208b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:19.225879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e920f5-6bc5-4aa6-af5a-7592ab6b208b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:19.226060 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e920f5-6bc5-4aa6-af5a-7592ab6b208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:19.244475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f3e920f5-6bc5-4aa6-af5a-7592ab6b208b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:19.245672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f3e920f5-6bc5-4aa6-af5a-7592ab6b208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:19.318451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 532/1047] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:19.340289 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7c096-bdc4-4373-9cb0-f712e578e8a4 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:19.359408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:19.449372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7c096-bdc4-4373-9cb0-f712e578e8a4 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:19.483052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd95bf-fb00-4e73-9d5f-4b2782401328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:19.483627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd95bf-fb00-4e73-9d5f-4b2782401328 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:19.483941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd95bf-fb00-4e73-9d5f-4b2782401328 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:19.484217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd95bf-fb00-4e73-9d5f-4b2782401328 None admin] PATH_INFO: `/v3/services/image` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:19.485414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd95bf-fb00-4e73-9d5f-4b2782401328 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:19.486857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd95bf-fb00-4e73-9d5f-4b2782401328 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-f8fd95bf-fb00-4e73-9d5f-4b2782401328 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:19.495796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:19.496800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:19.497633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:19.497633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:19.497633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:19.497633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:19.497633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:19.497633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:19.497633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:19.497633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:19.497633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:19.497633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:19.497633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:26:19.497633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:26:19.497633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 21:26:19.497633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:19.498995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 516/1048] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Jul 25 21:26:19 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:19.503529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e920f5-6bc5-4aa6-af5a-7592ab6b208b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:19.534275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a051df-7e27-45ae-b1b1-c877d04efbde None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:19.534804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a051df-7e27-45ae-b1b1-c877d04efbde None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:19.535089 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a051df-7e27-45ae-b1b1-c877d04efbde None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:19.537653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 517/1049] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:19.542474 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a7c6-ba24-4569-b366-50ac74ea6f95 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:19.542773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a7c6-ba24-4569-b366-50ac74ea6f95 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:19.543050 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809a7c6-ba24-4569-b366-50ac74ea6f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:19.563896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-f809a7c6-ba24-4569-b366-50ac74ea6f95 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:19.565125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-f809a7c6-ba24-4569-b366-50ac74ea6f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:19.614911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e920f5-6bc5-4aa6-af5a-7592ab6b208b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:19.616728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:19.639438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 518/1050] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:26:19.658775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb9b4d-7edf-4035-804f-235730f926b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:19.659398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb9b4d-7edf-4035-804f-235730f926b4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:19.659681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb9b4d-7edf-4035-804f-235730f926b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:19.659999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb9b4d-7edf-4035-804f-235730f926b4 None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:19.660685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb9b4d-7edf-4035-804f-235730f926b4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:19.660990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb9b4d-7edf-4035-804f-235730f926b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:19.662628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb9b4d-7edf-4035-804f-235730f926b4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:19.663945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809a7c6-ba24-4569-b366-50ac74ea6f95 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:19.667828 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 533/1051] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:19.668923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c719aee-da48-45b1-a11c-ef986263a76b None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:19.669210 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c719aee-da48-45b1-a11c-ef986263a76b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:19.669482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c719aee-da48-45b1-a11c-ef986263a76b None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:19.674372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 534/1052] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:19.675574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c719aee-da48-45b1-a11c-ef986263a76b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:19.678633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:19.766818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809a7c6-ba24-4569-b366-50ac74ea6f95 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:19.780061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c719aee-da48-45b1-a11c-ef986263a76b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:19.800818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fd905-ccef-423d-bc41-e52dd357d3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:19.801463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fd905-ccef-423d-bc41-e52dd357d3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:19.801746 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fd905-ccef-423d-bc41-e52dd357d3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:19.802020 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fd905-ccef-423d-bc41-e52dd357d3e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:19.812194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1fd905-ccef-423d-bc41-e52dd357d3e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:26:19.815132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a3d7a-d6c8-4243-b88e-8e25b023a9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:19.815773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3d7a-d6c8-4243-b88e-8e25b023a9bc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:19.816067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3d7a-d6c8-4243-b88e-8e25b023a9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:19.816345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3d7a-d6c8-4243-b88e-8e25b023a9bc None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:19.817027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a3d7a-d6c8-4243-b88e-8e25b023a9bc None admin] RBAC: Adding query filter params (type=image) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:19.817334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a3d7a-d6c8-4243-b88e-8e25b023a9bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-ee1fd905-ccef-423d-bc41-e52dd357d3e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:26:19.817677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:19.818723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:19.819675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:19.819675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:19.819675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:19.819675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:19.819675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:26:19.819675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:26:19.819675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:26:19.819675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:26:19.819675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:26:19.819675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:26:19.819675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:26:19.819675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:19.820386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a3d7a-d6c8-4243-b88e-8e25b023a9bc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:19.820459 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 519/1053] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:26:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:19.820526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610ef2-a0fe-4746-9663-9b726f605a9b None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:19.820815 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610ef2-a0fe-4746-9663-9b726f605a9b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:19.821096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610ef2-a0fe-4746-9663-9b726f605a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:19.825112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 535/1054] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:19.825894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a3d7a-d6c8-4243-b88e-8e25b023a9bc None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:19.841127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-60610ef2-a0fe-4746-9663-9b726f605a9b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:19.842346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-60610ef2-a0fe-4746-9663-9b726f605a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:19.855592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:19.905398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:19.910514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 520/1055] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:19.911547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60610ef2-a0fe-4746-9663-9b726f605a9b None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:19.932987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a3d7a-d6c8-4243-b88e-8e25b023a9bc None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:19.967520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f360a-855a-4b4b-9d65-d13356144954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:19.968162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f360a-855a-4b4b-9d65-d13356144954 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:19.968444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f360a-855a-4b4b-9d65-d13356144954 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:19.968720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f360a-855a-4b4b-9d65-d13356144954 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:19.969671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f360a-855a-4b4b-9d65-d13356144954 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:19.970200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f360a-855a-4b4b-9d65-d13356144954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:19.971601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f360a-855a-4b4b-9d65-d13356144954 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:19.980089 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 536/1056] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:26:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:19.980930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f360a-855a-4b4b-9d65-d13356144954 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:20.012257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60610ef2-a0fe-4746-9663-9b726f605a9b None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:20.045740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af776f-680c-4b62-ad12-afc52749327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:20.046294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af776f-680c-4b62-ad12-afc52749327b None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:20.046574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af776f-680c-4b62-ad12-afc52749327b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:20.046848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af776f-680c-4b62-ad12-afc52749327b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:20.048133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af776f-680c-4b62-ad12-afc52749327b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:20.049498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af776f-680c-4b62-ad12-afc52749327b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:20.075851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:20.084407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f360a-855a-4b4b-9d65-d13356144954 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:20.118279 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7b290-9ebf-4427-87ac-cbb099425146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:20.118972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7b290-9ebf-4427-87ac-cbb099425146 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:20.119267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7b290-9ebf-4427-87ac-cbb099425146 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:20.119580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7b290-9ebf-4427-87ac-cbb099425146 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:20.127304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 521/1057] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 21:26:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:26:20.128173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af776f-680c-4b62-ad12-afc52749327b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:20.130438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7b290-9ebf-4427-87ac-cbb099425146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-32b7b290-9ebf-4427-87ac-cbb099425146 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:26:20.135583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:20.136629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:20.137575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:20.137575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:20.137575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:20.137575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:20.137575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:26:20.137575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:26:20.137575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:26:20.137575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:26:20.137575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:26:20.137575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:26:20.137575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 21:26:20.137575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:20.137575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 537/1058] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 25 21:26:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:20.144167 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7b290-9ebf-4427-87ac-cbb099425146 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:20.199826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:20.262403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af776f-680c-4b62-ad12-afc52749327b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:20.263280 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7b290-9ebf-4427-87ac-cbb099425146 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:20.303070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a51522-8d5d-4c7d-94bf-dbf451df5f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:20.303644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51522-8d5d-4c7d-94bf-dbf451df5f7c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:20.303960 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51522-8d5d-4c7d-94bf-dbf451df5f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:20.304238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51522-8d5d-4c7d-94bf-dbf451df5f7c None admin] PATH_INFO: `/v3/users/9cb23c660162441b8871745d9c5b7a07` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:20.310269 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fea6c-c1d0-4534-8644-d3eb48c78ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:20.311973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fea6c-c1d0-4534-8644-d3eb48c78ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:20.311973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fea6c-c1d0-4534-8644-d3eb48c78ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:20.311973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fea6c-c1d0-4534-8644-d3eb48c78ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:20.313055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fea6c-c1d0-4534-8644-d3eb48c78ab8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:20.313055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fea6c-c1d0-4534-8644-d3eb48c78ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:20.315136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fea6c-c1d0-4534-8644-d3eb48c78ab8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:20.321715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a51522-8d5d-4c7d-94bf-dbf451df5f7c None admin] RBAC: Authorizing `identity:get_user(user_id=9cb23c660162441b8871745d9c5b7a07)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:20.323169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a51522-8d5d-4c7d-94bf-dbf451df5f7c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:20.324597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 538/1059] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 25 21:26:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:20.331063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 522/1060] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:26:20 2022] GET /identity/v3/users/9cb23c660162441b8871745d9c5b7a07 => generated 285 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:20.331347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fea6c-c1d0-4534-8644-d3eb48c78ab8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:20.332684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a51522-8d5d-4c7d-94bf-dbf451df5f7c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:20.350730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:20.442933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a51522-8d5d-4c7d-94bf-dbf451df5f7c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:20.443421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fea6c-c1d0-4534-8644-d3eb48c78ab8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:20.455672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:20.480736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b24649-f643-4816-aa9f-95992734e5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:20.481250 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddba2f-4df2-437c-bcd2-b674dd501c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:20.481372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b24649-f643-4816-aa9f-95992734e5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:20.481630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b24649-f643-4816-aa9f-95992734e5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:20.481883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddba2f-4df2-437c-bcd2-b674dd501c0b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:20.481996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b24649-f643-4816-aa9f-95992734e5e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:20.482073 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddba2f-4df2-437c-bcd2-b674dd501c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:20.482330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddba2f-4df2-437c-bcd2-b674dd501c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:20.493214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccddba2f-4df2-437c-bcd2-b674dd501c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:20.494679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccddba2f-4df2-437c-bcd2-b674dd501c0b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ccddba2f-4df2-437c-bcd2-b674dd501c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:26:20.514427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:20.515374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:20.517430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:26:20.517430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:26:20.517430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:20.517430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:20.517430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 539/1061] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:20.522238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddba2f-4df2-437c-bcd2-b674dd501c0b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:20.561824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b24649-f643-4816-aa9f-95992734e5e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:20.563676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b24649-f643-4816-aa9f-95992734e5e6 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:20.596073 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:20.635475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddba2f-4df2-437c-bcd2-b674dd501c0b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:20.668133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 523/1062] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:26:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:26:20.675016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b24649-f643-4816-aa9f-95992734e5e6 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:20.678545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c0d78-4682-4498-bf19-048121f8a286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:20.679430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c0d78-4682-4498-bf19-048121f8a286 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:20.679953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c0d78-4682-4498-bf19-048121f8a286 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:20.680436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c0d78-4682-4498-bf19-048121f8a286 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:20.681362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c0d78-4682-4498-bf19-048121f8a286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:20.681899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c0d78-4682-4498-bf19-048121f8a286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:20.683497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c0d78-4682-4498-bf19-048121f8a286 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:20.686944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:20.704133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 540/1063] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:20.707408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c0d78-4682-4498-bf19-048121f8a286 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:20.785427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b24649-f643-4816-aa9f-95992734e5e6 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:20.817361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c0d78-4682-4498-bf19-048121f8a286 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:20.820917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6543-5a6f-4f78-9af7-8c2191298fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:20.821561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6543-5a6f-4f78-9af7-8c2191298fac None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:20.821837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6543-5a6f-4f78-9af7-8c2191298fac None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:20.822105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6543-5a6f-4f78-9af7-8c2191298fac None admin] PATH_INFO: `/v3/projects/c166da4a3af34254831cc2084879c2ae` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:20.823248 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c6543-5a6f-4f78-9af7-8c2191298fac None admin] RBAC: Authorizing `identity:get_project(project_id=c166da4a3af34254831cc2084879c2ae)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:20.824680 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c6543-5a6f-4f78-9af7-8c2191298fac None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:20.826491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 524/1064] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:26:20 2022] GET /identity/v3/projects/c166da4a3af34254831cc2084879c2ae => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:20.832882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6543-5a6f-4f78-9af7-8c2191298fac None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:20.844400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:20.858340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df1613-acd4-4fde-8642-e771cec6a648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:20.859340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df1613-acd4-4fde-8642-e771cec6a648 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:20.860644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df1613-acd4-4fde-8642-e771cec6a648 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:20.862769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df1613-acd4-4fde-8642-e771cec6a648 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:20.873551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df1613-acd4-4fde-8642-e771cec6a648 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:20.876979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df1613-acd4-4fde-8642-e771cec6a648 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-15df1613-acd4-4fde-8642-e771cec6a648 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:26:20.898336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:20.899398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:20.900424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:20.900424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:20.900424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:26:20.900424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:26:20.900424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:26:20.900424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:26:20.900424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:26:20.900424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:26:20.900424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:26:20.900424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:20.900424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 541/1065] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 21:26:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:20.908068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df1613-acd4-4fde-8642-e771cec6a648 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:20.955292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:20.981514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6543-5a6f-4f78-9af7-8c2191298fac None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:21.017779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af154a-1596-44c7-822c-bef6fa5bcdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:21.018399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af154a-1596-44c7-822c-bef6fa5bcdfa None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:21.018846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af154a-1596-44c7-822c-bef6fa5bcdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:21.019127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af154a-1596-44c7-822c-bef6fa5bcdfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:21.020324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af154a-1596-44c7-822c-bef6fa5bcdfa None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=c166da4a3af34254831cc2084879c2ae, user.id=9cb23c660162441b8871745d9c5b7a07) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:21.020794 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af154a-1596-44c7-822c-bef6fa5bcdfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:21.022226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af154a-1596-44c7-822c-bef6fa5bcdfa None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:21.027776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 525/1066] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:26:20 2022] GET /identity/v3/role_assignments?user.id=9cb23c660162441b8871745d9c5b7a07&scope.project.id=c166da4a3af34254831cc2084879c2ae&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:21.040906 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df1613-acd4-4fde-8642-e771cec6a648 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:21.082406 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a49a4-8529-442d-adcb-0c50fe49abea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:21.083367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a49a4-8529-442d-adcb-0c50fe49abea None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:21.083886 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a49a4-8529-442d-adcb-0c50fe49abea None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:21.084360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a49a4-8529-442d-adcb-0c50fe49abea None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:21.085362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a49a4-8529-442d-adcb-0c50fe49abea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:21.085851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a49a4-8529-442d-adcb-0c50fe49abea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:21.087484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a49a4-8529-442d-adcb-0c50fe49abea None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:21.108831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 542/1067] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 21:26:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:21.115687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af154a-1596-44c7-822c-bef6fa5bcdfa None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:21.223800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af154a-1596-44c7-822c-bef6fa5bcdfa None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:21.258216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2783f9-c7e9-44e7-8e66-162137d34d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:21.258869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2783f9-c7e9-44e7-8e66-162137d34d22 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:21.259152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2783f9-c7e9-44e7-8e66-162137d34d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:21.259427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2783f9-c7e9-44e7-8e66-162137d34d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:21.271212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2783f9-c7e9-44e7-8e66-162137d34d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:21.272681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2783f9-c7e9-44e7-8e66-162137d34d22 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:21.274583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-fb2783f9-c7e9-44e7-8e66-162137d34d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:26:21.288395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:21.289361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:21.290267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:26:21.290267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:26:21.290267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:21.290267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:21.290267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 526/1068] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:21.295466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a49a4-8529-442d-adcb-0c50fe49abea None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:21.346737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:21.403032 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a49a4-8529-442d-adcb-0c50fe49abea None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:21.437688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb66c2-9b02-43f2-9839-999b56e8c2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:21.438902 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb66c2-9b02-43f2-9839-999b56e8c2ad None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:21.439183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb66c2-9b02-43f2-9839-999b56e8c2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:21.439477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb66c2-9b02-43f2-9839-999b56e8c2ad None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:21.440192 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb66c2-9b02-43f2-9839-999b56e8c2ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:21.440499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb66c2-9b02-43f2-9839-999b56e8c2ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:21.441858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb66c2-9b02-43f2-9839-999b56e8c2ad None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:21.454178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 543/1069] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:21.459471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2783f9-c7e9-44e7-8e66-162137d34d22 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:21.562481 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2783f9-c7e9-44e7-8e66-162137d34d22 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:21.597597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd319a0-d366-4ee0-a59d-6d57ca20585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:21.598165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd319a0-d366-4ee0-a59d-6d57ca20585b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:21.598445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd319a0-d366-4ee0-a59d-6d57ca20585b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:21.598773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd319a0-d366-4ee0-a59d-6d57ca20585b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:21.605602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd319a0-d366-4ee0-a59d-6d57ca20585b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:21.607041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd319a0-d366-4ee0-a59d-6d57ca20585b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-5dd319a0-d366-4ee0-a59d-6d57ca20585b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:26:21.618577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:21.619472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:21.620716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:26:21.620716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:26:21.620716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:26:21.620716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:26:21.620716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:26:21.620716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:26:21.620716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:26:21.620716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:21.624132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 527/1070] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:21.625685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb66c2-9b02-43f2-9839-999b56e8c2ad None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:21.737658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb66c2-9b02-43f2-9839-999b56e8c2ad None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:21.740271 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:21.773451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bb833-959f-4766-a759-19ae4e96614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:21.774072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bb833-959f-4766-a759-19ae4e96614d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:21.774354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bb833-959f-4766-a759-19ae4e96614d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:21.774629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bb833-959f-4766-a759-19ae4e96614d None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:21.775380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bb833-959f-4766-a759-19ae4e96614d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:21.775692 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bb833-959f-4766-a759-19ae4e96614d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:21.777154 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bb833-959f-4766-a759-19ae4e96614d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:21.790497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 544/1071] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:21.796201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd319a0-d366-4ee0-a59d-6d57ca20585b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:21.858468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:21.910983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd319a0-d366-4ee0-a59d-6d57ca20585b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:21.944766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813564c7-8120-495b-bc70-98baa8306d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:21.945434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813564c7-8120-495b-bc70-98baa8306d96 None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:21.945802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813564c7-8120-495b-bc70-98baa8306d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:21.945987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813564c7-8120-495b-bc70-98baa8306d96 None admin] PATH_INFO: `/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/7d3d6613476c445b82302df5025f3ce6/roles/631665972a484e5cbab7d504f76b20e4` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:21.948166 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813564c7-8120-495b-bc70-98baa8306d96 None admin] RBAC: Authorizing `identity:create_grant(project_id=48d9c81feed744bb9e322910711a0d3b, user_id=7d3d6613476c445b82302df5025f3ce6, role_id=631665972a484e5cbab7d504f76b20e4)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:21.949611 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813564c7-8120-495b-bc70-98baa8306d96 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:22.000072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 528/1072] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:26:21 2022] PUT /identity/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/7d3d6613476c445b82302df5025f3ce6/roles/631665972a484e5cbab7d504f76b20e4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:26:22.202898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efd8f3-118a-44ae-ae4c-92420339029b None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:22.203242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efd8f3-118a-44ae-ae4c-92420339029b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:22.203973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efd8f3-118a-44ae-ae4c-92420339029b None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:22.205661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 545/1073] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:22.210610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa5a6e-23d8-47a8-9a13-e63064958502 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:22.210931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa5a6e-23d8-47a8-9a13-e63064958502 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:22.211176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa5a6e-23d8-47a8-9a13-e63064958502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:22.229834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-98fa5a6e-23d8-47a8-9a13-e63064958502 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:22.231019 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-98fa5a6e-23d8-47a8-9a13-e63064958502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:22.298354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 529/1074] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:22.319590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efd8f3-118a-44ae-ae4c-92420339029b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:22.424807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efd8f3-118a-44ae-ae4c-92420339029b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:22.460559 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a68e6-048d-4746-97ed-d5f4bbc1bf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:22.461527 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a68e6-048d-4746-97ed-d5f4bbc1bf25 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:22.462018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a68e6-048d-4746-97ed-d5f4bbc1bf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:22.462497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a68e6-048d-4746-97ed-d5f4bbc1bf25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:22.495265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:22.537747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a68e6-048d-4746-97ed-d5f4bbc1bf25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:22.539211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a68e6-048d-4746-97ed-d5f4bbc1bf25 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:22.643779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 546/1075] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:26:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:26:22.646245 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa5a6e-23d8-47a8-9a13-e63064958502 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:22.698559 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:22.753777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa5a6e-23d8-47a8-9a13-e63064958502 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:22.788216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93139860-c34e-447b-a9c7-0dfc9c6ba344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:22.788856 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93139860-c34e-447b-a9c7-0dfc9c6ba344 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:22.789137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93139860-c34e-447b-a9c7-0dfc9c6ba344 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:22.789408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93139860-c34e-447b-a9c7-0dfc9c6ba344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:22.799836 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93139860-c34e-447b-a9c7-0dfc9c6ba344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:22.801267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93139860-c34e-447b-a9c7-0dfc9c6ba344 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-93139860-c34e-447b-a9c7-0dfc9c6ba344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:26:22.815919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:22.816912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:22.817812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:26:22.817812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:26:22.817812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:22.817812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:22.818601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 530/1076] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:22.823004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a68e6-048d-4746-97ed-d5f4bbc1bf25 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:22.886899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:22.926418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a68e6-048d-4746-97ed-d5f4bbc1bf25 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:22.960985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa38b79-d2b8-4b9e-a4fc-5453da1b9c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:22.961662 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38b79-d2b8-4b9e-a4fc-5453da1b9c40 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:22.961954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38b79-d2b8-4b9e-a4fc-5453da1b9c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:22.962233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38b79-d2b8-4b9e-a4fc-5453da1b9c40 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:22.962982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa38b79-d2b8-4b9e-a4fc-5453da1b9c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:22.963295 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa38b79-d2b8-4b9e-a4fc-5453da1b9c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:22.964682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa38b79-d2b8-4b9e-a4fc-5453da1b9c40 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:22.983782 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 547/1077] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:23.054460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1e290-b567-49b0-9b1f-729024b13ad0 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:23.054706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1e290-b567-49b0-9b1f-729024b13ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:23.054948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1e290-b567-49b0-9b1f-729024b13ad0 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:23.056537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 531/1078] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:23.062217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312606-4da9-499a-9ce4-4d202df22bf0 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:23.062510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312606-4da9-499a-9ce4-4d202df22bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:23.062820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d312606-4da9-499a-9ce4-4d202df22bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:23.082090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-1d312606-4da9-499a-9ce4-4d202df22bf0 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:23.083318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1d312606-4da9-499a-9ce4-4d202df22bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:23.162753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 548/1079] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:23.185190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1e290-b567-49b0-9b1f-729024b13ad0 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:23.289158 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:23.295772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1e290-b567-49b0-9b1f-729024b13ad0 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:23.330094 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722b3b4-610d-4293-bb02-916c752aed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:23.330692 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722b3b4-610d-4293-bb02-916c752aed82 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:23.330928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722b3b4-610d-4293-bb02-916c752aed82 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:23.331197 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722b3b4-610d-4293-bb02-916c752aed82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:23.340935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722b3b4-610d-4293-bb02-916c752aed82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-8722b3b4-610d-4293-bb02-916c752aed82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:26:23.346309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:23.347341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:23.348268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:23.348268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:23.348268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:23.348268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:23.348268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:26:23.348268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:26:23.348268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:26:23.348268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:26:23.348268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:26:23.348268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:26:23.348268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:26:23.348268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:23.348268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 532/1080] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:26:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:23.353462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d312606-4da9-499a-9ce4-4d202df22bf0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:23.407930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:23.452600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d312606-4da9-499a-9ce4-4d202df22bf0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:23.486891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d7ab2-6730-459f-8f68-8bb264786ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:23.487511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d7ab2-6730-459f-8f68-8bb264786ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:23.487823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d7ab2-6730-459f-8f68-8bb264786ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:23.488103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d7ab2-6730-459f-8f68-8bb264786ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:23.488827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d7ab2-6730-459f-8f68-8bb264786ef7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:23.489135 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d7ab2-6730-459f-8f68-8bb264786ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:23.490507 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d7ab2-6730-459f-8f68-8bb264786ef7 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:23.498425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 549/1081] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:26:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:23.504353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722b3b4-610d-4293-bb02-916c752aed82 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:23.603501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722b3b4-610d-4293-bb02-916c752aed82 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:23.636761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478ad7-4407-4136-869b-82313c15a6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:23.637400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478ad7-4407-4136-869b-82313c15a6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:23.637683 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478ad7-4407-4136-869b-82313c15a6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:23.637960 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478ad7-4407-4136-869b-82313c15a6c2 None admin] PATH_INFO: `/v3/users/9cb23c660162441b8871745d9c5b7a07` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:23.639118 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37478ad7-4407-4136-869b-82313c15a6c2 None admin] RBAC: Authorizing `identity:get_user(user_id=9cb23c660162441b8871745d9c5b7a07)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:23.640560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37478ad7-4407-4136-869b-82313c15a6c2 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:23.642343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 533/1082] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:26:23 2022] GET /identity/v3/users/9cb23c660162441b8871745d9c5b7a07 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:23.648021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d7ab2-6730-459f-8f68-8bb264786ef7 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:23.751056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d7ab2-6730-459f-8f68-8bb264786ef7 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:23.767439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:23.784528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf0acf-6165-40cc-8abf-749ddbd6a269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:23.785205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0acf-6165-40cc-8abf-749ddbd6a269 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:23.785426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0acf-6165-40cc-8abf-749ddbd6a269 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:23.785699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0acf-6165-40cc-8abf-749ddbd6a269 None admin] PATH_INFO: `/v3/projects/c166da4a3af34254831cc2084879c2ae` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:23.787103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf0acf-6165-40cc-8abf-749ddbd6a269 None admin] RBAC: Authorizing `identity:get_project(project_id=c166da4a3af34254831cc2084879c2ae)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:23.788557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf0acf-6165-40cc-8abf-749ddbd6a269 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:23.790219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 550/1083] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:26:23 2022] GET /identity/v3/projects/c166da4a3af34254831cc2084879c2ae => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:23.796216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478ad7-4407-4136-869b-82313c15a6c2 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:23.822757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:23.896344 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478ad7-4407-4136-869b-82313c15a6c2 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:23.930095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d61a7-8fc6-44a8-a759-68e28db5758d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:23.930754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d61a7-8fc6-44a8-a759-68e28db5758d None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:23.931031 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d61a7-8fc6-44a8-a759-68e28db5758d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:23.931300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d61a7-8fc6-44a8-a759-68e28db5758d None admin] PATH_INFO: `/v3/projects/c166da4a3af34254831cc2084879c2ae/users/9cb23c660162441b8871745d9c5b7a07/roles/11da9ce3f79148679dbde9eb2c568e55` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:23.933231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d61a7-8fc6-44a8-a759-68e28db5758d None admin] RBAC: Authorizing `identity:create_grant(project_id=c166da4a3af34254831cc2084879c2ae, user_id=9cb23c660162441b8871745d9c5b7a07, role_id=11da9ce3f79148679dbde9eb2c568e55)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:23.934633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d61a7-8fc6-44a8-a759-68e28db5758d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:23.999953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 534/1084] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:26:23 2022] PUT /identity/v3/projects/c166da4a3af34254831cc2084879c2ae/users/9cb23c660162441b8871745d9c5b7a07/roles/11da9ce3f79148679dbde9eb2c568e55 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:26:24.027006 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cb914-6400-4102-a49a-baab38f571e6 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:24.027298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cb914-6400-4102-a49a-baab38f571e6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:24.027575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cb914-6400-4102-a49a-baab38f571e6 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:24.029029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 551/1085] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:24.034994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d30ad-a3d0-4c2f-91be-33a781728c14 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:24.035282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d30ad-a3d0-4c2f-91be-33a781728c14 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:24.035557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d30ad-a3d0-4c2f-91be-33a781728c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:24.056292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-3b8d30ad-a3d0-4c2f-91be-33a781728c14 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:24.057561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-3b8d30ad-a3d0-4c2f-91be-33a781728c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:24.130025 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 535/1086] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:24.154596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cb914-6400-4102-a49a-baab38f571e6 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:24.257852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cb914-6400-4102-a49a-baab38f571e6 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:24.291671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b1ec3-14f4-43ab-aee1-56b131ce4b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:24.292340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b1ec3-14f4-43ab-aee1-56b131ce4b31 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:24.292623 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b1ec3-14f4-43ab-aee1-56b131ce4b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:24.292900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b1ec3-14f4-43ab-aee1-56b131ce4b31 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:24.302993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b1ec3-14f4-43ab-aee1-56b131ce4b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-642b1ec3-14f4-43ab-aee1-56b131ce4b31 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:26:24.307881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:24.308803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:24.309627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:24.309627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:24.309627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:24.309627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:24.309627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:26:24.309627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:26:24.309627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:26:24.309627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:26:24.309627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:26:24.309627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:26:24.309627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 21:26:24.309627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:24.309627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 552/1087] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 25 21:26:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:24.315831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d30ad-a3d0-4c2f-91be-33a781728c14 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:24.331334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:24.416489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d30ad-a3d0-4c2f-91be-33a781728c14 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:24.449389 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2d7a9-83af-4f24-a251-7275ec4fe822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:24.450004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2d7a9-83af-4f24-a251-7275ec4fe822 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:24.450281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2d7a9-83af-4f24-a251-7275ec4fe822 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:24.450551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2d7a9-83af-4f24-a251-7275ec4fe822 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:24.451258 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2d7a9-83af-4f24-a251-7275ec4fe822 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:24.451668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2d7a9-83af-4f24-a251-7275ec4fe822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:24.453041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2d7a9-83af-4f24-a251-7275ec4fe822 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:24.461627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 536/1088] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 25 21:26:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:24.467304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b1ec3-14f4-43ab-aee1-56b131ce4b31 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:24.513740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:24.568620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b1ec3-14f4-43ab-aee1-56b131ce4b31 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:24.602023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31e781-910f-43e8-82b2-1e3bce034aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:24.602659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31e781-910f-43e8-82b2-1e3bce034aba None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:24.602939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31e781-910f-43e8-82b2-1e3bce034aba None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:24.603212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31e781-910f-43e8-82b2-1e3bce034aba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:24.613864 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31e781-910f-43e8-82b2-1e3bce034aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:24.615316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31e781-910f-43e8-82b2-1e3bce034aba None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-9f31e781-910f-43e8-82b2-1e3bce034aba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:26:24.630562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:24.631589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:24.632562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:26:24.632562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:26:24.632562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:24.632562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:24.632562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 553/1089] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:24.637368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2d7a9-83af-4f24-a251-7275ec4fe822 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:24.717581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:24.740416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2d7a9-83af-4f24-a251-7275ec4fe822 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:24.774284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae16cf-00ee-4b92-bf9f-91d3be0a8be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:24.774904 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae16cf-00ee-4b92-bf9f-91d3be0a8be0 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:24.775187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae16cf-00ee-4b92-bf9f-91d3be0a8be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:24.775463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae16cf-00ee-4b92-bf9f-91d3be0a8be0 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:24.776186 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae16cf-00ee-4b92-bf9f-91d3be0a8be0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:24.776536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae16cf-00ee-4b92-bf9f-91d3be0a8be0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:24.777859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae16cf-00ee-4b92-bf9f-91d3be0a8be0 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:24.790272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 537/1090] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:24.795763 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31e781-910f-43e8-82b2-1e3bce034aba None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:24.889067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:24.894910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31e781-910f-43e8-82b2-1e3bce034aba None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:24.929493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac52b8-1357-4ed4-b855-6ccd1bd97bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:24.930125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac52b8-1357-4ed4-b855-6ccd1bd97bdd None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:24.930408 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac52b8-1357-4ed4-b855-6ccd1bd97bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:24.930685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac52b8-1357-4ed4-b855-6ccd1bd97bdd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:24.937576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac52b8-1357-4ed4-b855-6ccd1bd97bdd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:24.939050 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac52b8-1357-4ed4-b855-6ccd1bd97bdd None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-12ac52b8-1357-4ed4-b855-6ccd1bd97bdd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:26:24.950647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:24.951544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:24.952900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:24.952900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:24.952900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:26:24.952900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:26:24.952900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:26:24.952900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:26:24.952900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:26:24.952900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:26:24.952900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 21:26:24.952900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:24.952900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 554/1091] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 25 21:26:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:24.957470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae16cf-00ee-4b92-bf9f-91d3be0a8be0 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:25.056503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae16cf-00ee-4b92-bf9f-91d3be0a8be0 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:25.089990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ce095-f4b4-4f33-871f-dd6ab7a805fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:25.090615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ce095-f4b4-4f33-871f-dd6ab7a805fa None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:25.090894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ce095-f4b4-4f33-871f-dd6ab7a805fa None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:25.091164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ce095-f4b4-4f33-871f-dd6ab7a805fa None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:25.091984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ce095-f4b4-4f33-871f-dd6ab7a805fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:25.092288 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ce095-f4b4-4f33-871f-dd6ab7a805fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:25.093696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ce095-f4b4-4f33-871f-dd6ab7a805fa None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:25.096880 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:25.114500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 538/1092] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 25 21:26:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:25.120203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac52b8-1357-4ed4-b855-6ccd1bd97bdd None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:25.220818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac52b8-1357-4ed4-b855-6ccd1bd97bdd None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:25.256171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f5083-ddee-4fee-9501-89aebd5e07e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:25.256788 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f5083-ddee-4fee-9501-89aebd5e07e7 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:25.257072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f5083-ddee-4fee-9501-89aebd5e07e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:25.257346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f5083-ddee-4fee-9501-89aebd5e07e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:25.282447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:25.324430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f5083-ddee-4fee-9501-89aebd5e07e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:25.325876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f5083-ddee-4fee-9501-89aebd5e07e7 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:25.422380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 555/1093] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:26:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:26:25.428013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ce095-f4b4-4f33-871f-dd6ab7a805fa None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:25.527244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ce095-f4b4-4f33-871f-dd6ab7a805fa None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:25.567351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aca73f-c1d0-42c0-b45b-11baca6c748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:25.568047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aca73f-c1d0-42c0-b45b-11baca6c748b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:25.568334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aca73f-c1d0-42c0-b45b-11baca6c748b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:25.568610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aca73f-c1d0-42c0-b45b-11baca6c748b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:25.579516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aca73f-c1d0-42c0-b45b-11baca6c748b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:25.580975 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aca73f-c1d0-42c0-b45b-11baca6c748b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-01aca73f-c1d0-42c0-b45b-11baca6c748b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:26:25.596223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:25.597218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:25.598113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:26:25.598113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:26:25.598113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:26:25.598113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:25.598113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 539/1094] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:25.603049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f5083-ddee-4fee-9501-89aebd5e07e7 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:25.659224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:25.704979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f5083-ddee-4fee-9501-89aebd5e07e7 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:25.738260 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8735e9b-20b6-4a1c-b9f6-7786ae4b7f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:25.738883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8735e9b-20b6-4a1c-b9f6-7786ae4b7f56 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:25.739170 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8735e9b-20b6-4a1c-b9f6-7786ae4b7f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:25.739448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8735e9b-20b6-4a1c-b9f6-7786ae4b7f56 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:25.740174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8735e9b-20b6-4a1c-b9f6-7786ae4b7f56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:25.740483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8735e9b-20b6-4a1c-b9f6-7786ae4b7f56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:25.741856 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8735e9b-20b6-4a1c-b9f6-7786ae4b7f56 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:25.753968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 556/1095] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:25.759571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aca73f-c1d0-42c0-b45b-11baca6c748b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:25.805430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:25.858747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aca73f-c1d0-42c0-b45b-11baca6c748b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:25.892714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc0a6a-b854-4ce1-83e8-833d1a01cde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:25.893353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc0a6a-b854-4ce1-83e8-833d1a01cde1 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:25.893637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc0a6a-b854-4ce1-83e8-833d1a01cde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:25.893913 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc0a6a-b854-4ce1-83e8-833d1a01cde1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:25.900510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc0a6a-b854-4ce1-83e8-833d1a01cde1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:25.901952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc0a6a-b854-4ce1-83e8-833d1a01cde1 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-d0bc0a6a-b854-4ce1-83e8-833d1a01cde1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:26:25.914179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:25.915129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:25.916074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:26:25.916074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:26:25.916074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:26:25.916074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:26:25.916074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:26:25.916074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:26:25.916074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:26:25.916074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:25.916074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 540/1096] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:26:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:25.921122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8735e9b-20b6-4a1c-b9f6-7786ae4b7f56 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:26.014694 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a707d09-504c-4de4-954b-94a15d9ca397 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:26.014978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a707d09-504c-4de4-954b-94a15d9ca397 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:26.015256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a707d09-504c-4de4-954b-94a15d9ca397 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:26.017237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 541/1097] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:26.020898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8735e9b-20b6-4a1c-b9f6-7786ae4b7f56 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:26.022109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c607-73d4-4600-93bf-e037100b3545 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:26.022402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c607-73d4-4600-93bf-e037100b3545 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:26.022680 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c607-73d4-4600-93bf-e037100b3545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:26.038277 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:26.041304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-6bb3c607-73d4-4600-93bf-e037100b3545 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:26.042495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-6bb3c607-73d4-4600-93bf-e037100b3545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:26.056005 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fb81c-07d3-4047-8487-19fc4cde90e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:26.056556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fb81c-07d3-4047-8487-19fc4cde90e3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:26.056834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fb81c-07d3-4047-8487-19fc4cde90e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:26.057104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fb81c-07d3-4047-8487-19fc4cde90e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:26.057862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fb81c-07d3-4047-8487-19fc4cde90e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:26.058168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fb81c-07d3-4047-8487-19fc4cde90e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:26.059644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fb81c-07d3-4047-8487-19fc4cde90e3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:26.076123 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 557/1098] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:26:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:26.077236 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fb81c-07d3-4047-8487-19fc4cde90e3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:26.113262 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 542/1099] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:26.136250 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3c607-73d4-4600-93bf-e037100b3545 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:26.170557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:26.178310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fb81c-07d3-4047-8487-19fc4cde90e3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:26.215701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714adaa2-585e-468d-8565-8a78393d188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:26.216346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714adaa2-585e-468d-8565-8a78393d188b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:26.216631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714adaa2-585e-468d-8565-8a78393d188b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:26.216910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714adaa2-585e-468d-8565-8a78393d188b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:26.217711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714adaa2-585e-468d-8565-8a78393d188b None admin] RBAC: Adding query filter params (role.id=631665972a484e5cbab7d504f76b20e4, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=7d3d6613476c445b82302df5025f3ce6) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:26.218027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714adaa2-585e-468d-8565-8a78393d188b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:26.220325 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714adaa2-585e-468d-8565-8a78393d188b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:26.239771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 558/1100] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:26:26 2022] GET /identity/v3/role_assignments?user.id=7d3d6613476c445b82302df5025f3ce6&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=631665972a484e5cbab7d504f76b20e4 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:26.243359 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3c607-73d4-4600-93bf-e037100b3545 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:26.280137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33739a6-cf2b-4339-a9a2-d2ac1c8f54a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:26.280819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33739a6-cf2b-4339-a9a2-d2ac1c8f54a5 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:26.281103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33739a6-cf2b-4339-a9a2-d2ac1c8f54a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:26.281378 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33739a6-cf2b-4339-a9a2-d2ac1c8f54a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:26.293909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33739a6-cf2b-4339-a9a2-d2ac1c8f54a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-e33739a6-cf2b-4339-a9a2-d2ac1c8f54a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:26:26.299479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:26.300500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:26.301353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:26.301353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:26.301353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:26.301353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:26.301353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:26:26.301353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:26:26.301353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:26:26.301353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:26:26.301353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:26:26.301353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:26:26.301353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:26:26.301353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:26.301353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 543/1101] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:26:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:26.307171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714adaa2-585e-468d-8565-8a78393d188b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:26.353556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:26.417847 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714adaa2-585e-468d-8565-8a78393d188b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:26.452666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac812827-5050-47bb-a64b-554671253a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:26.453316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812827-5050-47bb-a64b-554671253a42 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:26.453644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812827-5050-47bb-a64b-554671253a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:26.453644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812827-5050-47bb-a64b-554671253a42 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:26.454593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac812827-5050-47bb-a64b-554671253a42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:26.454900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac812827-5050-47bb-a64b-554671253a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:26.456313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac812827-5050-47bb-a64b-554671253a42 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:26.465238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 559/1102] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:26:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:26.472347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33739a6-cf2b-4339-a9a2-d2ac1c8f54a5 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:26.570733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:26.576446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33739a6-cf2b-4339-a9a2-d2ac1c8f54a5 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:26.649636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44343547-ce05-4c36-b7d0-e93752f96c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:26.650282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343547-ce05-4c36-b7d0-e93752f96c3f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:26.650564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343547-ce05-4c36-b7d0-e93752f96c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:26.650840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343547-ce05-4c36-b7d0-e93752f96c3f None admin] PATH_INFO: `/v3/users/9cb23c660162441b8871745d9c5b7a07` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:26.652053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44343547-ce05-4c36-b7d0-e93752f96c3f None admin] RBAC: Authorizing `identity:get_user(user_id=9cb23c660162441b8871745d9c5b7a07)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:26.653479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44343547-ce05-4c36-b7d0-e93752f96c3f None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:26.655195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 544/1103] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:26:26 2022] GET /identity/v3/users/9cb23c660162441b8871745d9c5b7a07 => generated 285 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:26.662648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac812827-5050-47bb-a64b-554671253a42 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:26.770321 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac812827-5050-47bb-a64b-554671253a42 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:26.771899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:26.808391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421139e-6ec9-4c4a-af42-de8d3fcf51cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:26.809380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421139e-6ec9-4c4a-af42-de8d3fcf51cb None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:26.809849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421139e-6ec9-4c4a-af42-de8d3fcf51cb None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:26.810291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421139e-6ec9-4c4a-af42-de8d3fcf51cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:26.881138 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421139e-6ec9-4c4a-af42-de8d3fcf51cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:26.882523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421139e-6ec9-4c4a-af42-de8d3fcf51cb None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:26.987119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 560/1104] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:26:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:26:26.993218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44343547-ce05-4c36-b7d0-e93752f96c3f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:27.098416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44343547-ce05-4c36-b7d0-e93752f96c3f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:27.131346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471c993-8d7b-48ce-8d51-b98b6ba6f0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:27.131946 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c993-8d7b-48ce-8d51-b98b6ba6f0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:27.132229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c993-8d7b-48ce-8d51-b98b6ba6f0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:27.132504 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471c993-8d7b-48ce-8d51-b98b6ba6f0d7 None admin] PATH_INFO: `/v3/projects/c166da4a3af34254831cc2084879c2ae` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:27.133644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471c993-8d7b-48ce-8d51-b98b6ba6f0d7 None admin] RBAC: Authorizing `identity:get_project(project_id=c166da4a3af34254831cc2084879c2ae)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:27.135085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471c993-8d7b-48ce-8d51-b98b6ba6f0d7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:27.136771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 545/1105] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:26:26 2022] GET /identity/v3/projects/c166da4a3af34254831cc2084879c2ae => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:27.143696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421139e-6ec9-4c4a-af42-de8d3fcf51cb None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:27.145938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:27.240892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421139e-6ec9-4c4a-af42-de8d3fcf51cb None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:27.274555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27408693-245a-47a2-8759-45dce9ab8823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:27.275158 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408693-245a-47a2-8759-45dce9ab8823 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:27.275444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408693-245a-47a2-8759-45dce9ab8823 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:27.275721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27408693-245a-47a2-8759-45dce9ab8823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:27.276536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27408693-245a-47a2-8759-45dce9ab8823 None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=c166da4a3af34254831cc2084879c2ae, user.id=9cb23c660162441b8871745d9c5b7a07) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:27.276848 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27408693-245a-47a2-8759-45dce9ab8823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:27.278279 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27408693-245a-47a2-8759-45dce9ab8823 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:27.283969 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 561/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:26:27 2022] GET /identity/v3/role_assignments?user.id=9cb23c660162441b8871745d9c5b7a07&scope.project.id=c166da4a3af34254831cc2084879c2ae&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:29.302986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9969ea8-63b1-4f5e-bed7-188337f808ab None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:29.303624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9969ea8-63b1-4f5e-bed7-188337f808ab None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:29.303624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9969ea8-63b1-4f5e-bed7-188337f808ab None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:29.304873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 546/1107] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:29.309916 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e52c13-6b97-44af-9954-81346c016f18 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:29.310339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e52c13-6b97-44af-9954-81346c016f18 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:29.310483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e52c13-6b97-44af-9954-81346c016f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:29.328868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-37e52c13-6b97-44af-9954-81346c016f18 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:29.330108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-37e52c13-6b97-44af-9954-81346c016f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:29.388339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:29.396316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 562/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:29.420246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9969ea8-63b1-4f5e-bed7-188337f808ab None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:29.452001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:29.521491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9969ea8-63b1-4f5e-bed7-188337f808ab None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:29.554333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8b60a-11be-496f-b2ee-f69b5d36ddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:29.554906 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b60a-11be-496f-b2ee-f69b5d36ddd2 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:29.555188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b60a-11be-496f-b2ee-f69b5d36ddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:29.555461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b60a-11be-496f-b2ee-f69b5d36ddd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:29.556653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8b60a-11be-496f-b2ee-f69b5d36ddd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:29.558068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8b60a-11be-496f-b2ee-f69b5d36ddd2 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:29.559636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 547/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:29.566171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e52c13-6b97-44af-9954-81346c016f18 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:29.664431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e52c13-6b97-44af-9954-81346c016f18 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:29.698264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14facf21-df05-466e-8a8f-16d6ad335db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:29.698888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14facf21-df05-466e-8a8f-16d6ad335db4 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:29.699174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14facf21-df05-466e-8a8f-16d6ad335db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:29.699452 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14facf21-df05-466e-8a8f-16d6ad335db4 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:29.700176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14facf21-df05-466e-8a8f-16d6ad335db4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:29.701604 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14facf21-df05-466e-8a8f-16d6ad335db4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:29.811257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 563/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:26:29 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:26:31.853779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1315f5-d8b0-4905-afcf-1d72c19eeee5 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:31.854332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1315f5-d8b0-4905-afcf-1d72c19eeee5 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:31.854332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1315f5-d8b0-4905-afcf-1d72c19eeee5 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:31.855660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 548/1111] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:31.861164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186b6f-6507-4e4b-b187-98d9cf43da09 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:31.861571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186b6f-6507-4e4b-b187-98d9cf43da09 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:31.861723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac186b6f-6507-4e4b-b187-98d9cf43da09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:31.880535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ac186b6f-6507-4e4b-b187-98d9cf43da09 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:31.881726 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ac186b6f-6507-4e4b-b187-98d9cf43da09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:31.928022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:31.947797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 564/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:31.972041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1315f5-d8b0-4905-afcf-1d72c19eeee5 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:32.066527 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:32.070261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1315f5-d8b0-4905-afcf-1d72c19eeee5 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:32.102523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28422a35-f585-4efd-ae90-ec3702624ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:32.103151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28422a35-f585-4efd-ae90-ec3702624ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:32.103431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28422a35-f585-4efd-ae90-ec3702624ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:32.103705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28422a35-f585-4efd-ae90-ec3702624ce9 None admin] PATH_INFO: `/v3/roles/8595eaa9629b4ec4a628d662402fd25d` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:32.105150 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28422a35-f585-4efd-ae90-ec3702624ce9 None admin] RBAC: Authorizing `identity:get_role(role_id=8595eaa9629b4ec4a628d662402fd25d)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:32.106508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28422a35-f585-4efd-ae90-ec3702624ce9 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:32.107844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 549/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:26:31 2022] GET /identity/v3/roles/8595eaa9629b4ec4a628d662402fd25d => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:32.114578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac186b6f-6507-4e4b-b187-98d9cf43da09 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:32.211632 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac186b6f-6507-4e4b-b187-98d9cf43da09 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:32.244454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f91b3-455e-4916-9b3b-e2726ee210ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:32.245082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f91b3-455e-4916-9b3b-e2726ee210ee None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:32.245365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f91b3-455e-4916-9b3b-e2726ee210ee None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:32.245641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f91b3-455e-4916-9b3b-e2726ee210ee None admin] PATH_INFO: `/v3/users/85664ba6933247db98c11b9dec07aedb` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:32.259256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f91b3-455e-4916-9b3b-e2726ee210ee None admin] RBAC: Authorizing `identity:get_user(user_id=85664ba6933247db98c11b9dec07aedb)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:32.260718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f91b3-455e-4916-9b3b-e2726ee210ee None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:32.262412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 565/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:26:32 2022] GET /identity/v3/users/85664ba6933247db98c11b9dec07aedb => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:32.268132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28422a35-f585-4efd-ae90-ec3702624ce9 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:32.364189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28422a35-f585-4efd-ae90-ec3702624ce9 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:32.396948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a2870-0330-465f-b1c7-f160fe9cab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:32.397554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a2870-0330-465f-b1c7-f160fe9cab43 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:32.397837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a2870-0330-465f-b1c7-f160fe9cab43 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:32.398112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a2870-0330-465f-b1c7-f160fe9cab43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:32.433209 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:32.464586 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a2870-0330-465f-b1c7-f160fe9cab43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:32.465948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a2870-0330-465f-b1c7-f160fe9cab43 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:32.564310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 550/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:26:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:26:32.570311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f91b3-455e-4916-9b3b-e2726ee210ee None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:32.650599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:32.709333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f91b3-455e-4916-9b3b-e2726ee210ee None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:32.742717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dade3d-67de-4233-99b1-ff07f098031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:32.743291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dade3d-67de-4233-99b1-ff07f098031d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:32.743573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dade3d-67de-4233-99b1-ff07f098031d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:32.743880 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dade3d-67de-4233-99b1-ff07f098031d None admin] PATH_INFO: `/v3/projects/c166da4a3af34254831cc2084879c2ae` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:32.745035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dade3d-67de-4233-99b1-ff07f098031d None admin] RBAC: Authorizing `identity:get_project(project_id=c166da4a3af34254831cc2084879c2ae)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:32.746469 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dade3d-67de-4233-99b1-ff07f098031d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:32.748154 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 566/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:26:32 2022] GET /identity/v3/projects/c166da4a3af34254831cc2084879c2ae => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:32.754373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a2870-0330-465f-b1c7-f160fe9cab43 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:32.819304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:32.852742 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a2870-0330-465f-b1c7-f160fe9cab43 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:32.884700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14109b48-cd27-4b42-a882-c1999fe3ff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:32.885307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14109b48-cd27-4b42-a882-c1999fe3ff49 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:32.885588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14109b48-cd27-4b42-a882-c1999fe3ff49 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:32.885860 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14109b48-cd27-4b42-a882-c1999fe3ff49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:32.886644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14109b48-cd27-4b42-a882-c1999fe3ff49 None admin] RBAC: Adding query filter params (role.id=8595eaa9629b4ec4a628d662402fd25d, scope.project.id=c166da4a3af34254831cc2084879c2ae, user.id=85664ba6933247db98c11b9dec07aedb) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:32.886955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14109b48-cd27-4b42-a882-c1999fe3ff49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:32.888401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14109b48-cd27-4b42-a882-c1999fe3ff49 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:32.894227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 551/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:26:32 2022] GET /identity/v3/role_assignments?user.id=85664ba6933247db98c11b9dec07aedb&scope.project.id=c166da4a3af34254831cc2084879c2ae&role.id=8595eaa9629b4ec4a628d662402fd25d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:34.865295 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d264e9b-a53c-4838-a3e7-2eec9320f40e None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:34.865861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d264e9b-a53c-4838-a3e7-2eec9320f40e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:34.865861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d264e9b-a53c-4838-a3e7-2eec9320f40e None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:34.867260 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 567/1118] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:34.872779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405e88-444b-43ef-8dd2-003e4f131b21 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:34.873152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405e88-444b-43ef-8dd2-003e4f131b21 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:34.873337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8405e88-444b-43ef-8dd2-003e4f131b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:34.891037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-d8405e88-444b-43ef-8dd2-003e4f131b21 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:34.892237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-d8405e88-444b-43ef-8dd2-003e4f131b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:34.957244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 552/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:34.979676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d264e9b-a53c-4838-a3e7-2eec9320f40e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:35.079923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d264e9b-a53c-4838-a3e7-2eec9320f40e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:35.088835 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:35.113011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274d939-db1a-4945-8e2c-5bdbe410a100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:35.113635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d939-db1a-4945-8e2c-5bdbe410a100 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:35.113918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d939-db1a-4945-8e2c-5bdbe410a100 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:35.114195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274d939-db1a-4945-8e2c-5bdbe410a100 None admin] PATH_INFO: `/v3/roles/8595eaa9629b4ec4a628d662402fd25d` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:35.115697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274d939-db1a-4945-8e2c-5bdbe410a100 None admin] RBAC: Authorizing `identity:get_role(role_id=8595eaa9629b4ec4a628d662402fd25d)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:35.117138 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274d939-db1a-4945-8e2c-5bdbe410a100 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:35.118639 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 568/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:26:34 2022] GET /identity/v3/roles/8595eaa9629b4ec4a628d662402fd25d => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:35.124209 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8405e88-444b-43ef-8dd2-003e4f131b21 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:35.183576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:35.222695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8405e88-444b-43ef-8dd2-003e4f131b21 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:35.254943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aba3ba-c837-4587-ae86-92b0d8f0cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:35.255576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aba3ba-c837-4587-ae86-92b0d8f0cd78 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:35.255886 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aba3ba-c837-4587-ae86-92b0d8f0cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:35.256169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aba3ba-c837-4587-ae86-92b0d8f0cd78 None admin] PATH_INFO: `/v3/users/85664ba6933247db98c11b9dec07aedb` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:35.257307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aba3ba-c837-4587-ae86-92b0d8f0cd78 None admin] RBAC: Authorizing `identity:get_user(user_id=85664ba6933247db98c11b9dec07aedb)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:35.258730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aba3ba-c837-4587-ae86-92b0d8f0cd78 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:35.260334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 553/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:26:35 2022] GET /identity/v3/users/85664ba6933247db98c11b9dec07aedb => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:35.266690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274d939-db1a-4945-8e2c-5bdbe410a100 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:35.363319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274d939-db1a-4945-8e2c-5bdbe410a100 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:35.397445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e1b6e-035a-418c-b1eb-ffd06f8021ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:35.398066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e1b6e-035a-418c-b1eb-ffd06f8021ef None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:35.398345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e1b6e-035a-418c-b1eb-ffd06f8021ef None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:35.398618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e1b6e-035a-418c-b1eb-ffd06f8021ef None admin] PATH_INFO: `/v3/projects/c166da4a3af34254831cc2084879c2ae` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:35.399785 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e1b6e-035a-418c-b1eb-ffd06f8021ef None admin] RBAC: Authorizing `identity:get_project(project_id=c166da4a3af34254831cc2084879c2ae)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:35.401200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e1b6e-035a-418c-b1eb-ffd06f8021ef None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:35.402833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 569/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:26:35 2022] GET /identity/v3/projects/c166da4a3af34254831cc2084879c2ae => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:35.408816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aba3ba-c837-4587-ae86-92b0d8f0cd78 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:35.506356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aba3ba-c837-4587-ae86-92b0d8f0cd78 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:35.534196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:35.539943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7fcb0-b9f8-4430-ae38-a80034d5e649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:35.540666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7fcb0-b9f8-4430-ae38-a80034d5e649 None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:35.544008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7fcb0-b9f8-4430-ae38-a80034d5e649 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:35.544008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7fcb0-b9f8-4430-ae38-a80034d5e649 None admin] PATH_INFO: `/v3/projects/c166da4a3af34254831cc2084879c2ae/users/85664ba6933247db98c11b9dec07aedb/roles/8595eaa9629b4ec4a628d662402fd25d` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:35.544008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7fcb0-b9f8-4430-ae38-a80034d5e649 None admin] RBAC: Authorizing `identity:create_grant(project_id=c166da4a3af34254831cc2084879c2ae, user_id=85664ba6933247db98c11b9dec07aedb, role_id=8595eaa9629b4ec4a628d662402fd25d)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:35.545284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7fcb0-b9f8-4430-ae38-a80034d5e649 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:35.610803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 554/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:26:35 2022] PUT /identity/v3/projects/c166da4a3af34254831cc2084879c2ae/users/85664ba6933247db98c11b9dec07aedb/roles/8595eaa9629b4ec4a628d662402fd25d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:26:37.643050 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479535d-75c9-4e35-a2a2-b42036caf9bb None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:37.643601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479535d-75c9-4e35-a2a2-b42036caf9bb None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:37.643601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479535d-75c9-4e35-a2a2-b42036caf9bb None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:37.644966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 570/1124] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:37.650030 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75fcb1-cb47-45be-809a-4e0e005b8804 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:37.650446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75fcb1-cb47-45be-809a-4e0e005b8804 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:37.650584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75fcb1-cb47-45be-809a-4e0e005b8804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:37.669118 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-6e75fcb1-cb47-45be-809a-4e0e005b8804 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:37.670341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-6e75fcb1-cb47-45be-809a-4e0e005b8804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:37.737233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 555/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:37.760183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479535d-75c9-4e35-a2a2-b42036caf9bb None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:37.806838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:37.858493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479535d-75c9-4e35-a2a2-b42036caf9bb None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:37.891751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93296d15-83f7-4c59-be2a-fcc1f5e3f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:37.892393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93296d15-83f7-4c59-be2a-fcc1f5e3f4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:37.892672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93296d15-83f7-4c59-be2a-fcc1f5e3f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:37.892945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93296d15-83f7-4c59-be2a-fcc1f5e3f4a3 None admin] PATH_INFO: `/v3/roles/8595eaa9629b4ec4a628d662402fd25d` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:37.894421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93296d15-83f7-4c59-be2a-fcc1f5e3f4a3 None admin] RBAC: Authorizing `identity:get_role(role_id=8595eaa9629b4ec4a628d662402fd25d)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:37.895766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93296d15-83f7-4c59-be2a-fcc1f5e3f4a3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:37.897087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 571/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:26:37 2022] GET /identity/v3/roles/8595eaa9629b4ec4a628d662402fd25d => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:37.902883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75fcb1-cb47-45be-809a-4e0e005b8804 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:37.999012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75fcb1-cb47-45be-809a-4e0e005b8804 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:38.018649 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:38.032740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9df319-d51d-4e44-b55a-9d10b29d3cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:38.033371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9df319-d51d-4e44-b55a-9d10b29d3cca None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:38.033656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9df319-d51d-4e44-b55a-9d10b29d3cca None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:38.033935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9df319-d51d-4e44-b55a-9d10b29d3cca None admin] PATH_INFO: `/v3/users/85664ba6933247db98c11b9dec07aedb` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:38.035243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9df319-d51d-4e44-b55a-9d10b29d3cca None admin] RBAC: Authorizing `identity:get_user(user_id=85664ba6933247db98c11b9dec07aedb)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:38.037009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9df319-d51d-4e44-b55a-9d10b29d3cca None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:38.038989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 556/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:26:37 2022] GET /identity/v3/users/85664ba6933247db98c11b9dec07aedb => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:38.044540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93296d15-83f7-4c59-be2a-fcc1f5e3f4a3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:38.141589 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93296d15-83f7-4c59-be2a-fcc1f5e3f4a3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:38.154181 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:38.174904 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e9249-0d5b-4b6f-b918-551394ab94d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:38.175515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e9249-0d5b-4b6f-b918-551394ab94d3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:38.175828 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e9249-0d5b-4b6f-b918-551394ab94d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:38.176105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e9249-0d5b-4b6f-b918-551394ab94d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:38.241790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e9249-0d5b-4b6f-b918-551394ab94d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:38.243243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e9249-0d5b-4b6f-b918-551394ab94d3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:38.338286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 572/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:26:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:26:38.344622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9df319-d51d-4e44-b55a-9d10b29d3cca None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:38.441491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9df319-d51d-4e44-b55a-9d10b29d3cca None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:38.473691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b6021-c19c-445c-ba49-77a54e28e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:38.474319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b6021-c19c-445c-ba49-77a54e28e6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:38.474600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b6021-c19c-445c-ba49-77a54e28e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:38.474875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b6021-c19c-445c-ba49-77a54e28e6a3 None admin] PATH_INFO: `/v3/projects/c166da4a3af34254831cc2084879c2ae` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:38.476120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b6021-c19c-445c-ba49-77a54e28e6a3 None admin] RBAC: Authorizing `identity:get_project(project_id=c166da4a3af34254831cc2084879c2ae)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:38.477533 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b6021-c19c-445c-ba49-77a54e28e6a3 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:38.479150 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 557/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:26:38 2022] GET /identity/v3/projects/c166da4a3af34254831cc2084879c2ae => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:38.485812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e9249-0d5b-4b6f-b918-551394ab94d3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:38.499553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:38.584751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e9249-0d5b-4b6f-b918-551394ab94d3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:38.618333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab5a55-fa94-4987-97f7-f9f3a1e19d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:38.618969 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab5a55-fa94-4987-97f7-f9f3a1e19d94 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:38.619254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab5a55-fa94-4987-97f7-f9f3a1e19d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:38.619532 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab5a55-fa94-4987-97f7-f9f3a1e19d94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:38.620365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab5a55-fa94-4987-97f7-f9f3a1e19d94 None admin] RBAC: Adding query filter params (role.id=8595eaa9629b4ec4a628d662402fd25d, scope.project.id=c166da4a3af34254831cc2084879c2ae, user.id=85664ba6933247db98c11b9dec07aedb) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:38.620679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab5a55-fa94-4987-97f7-f9f3a1e19d94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:38.622110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab5a55-fa94-4987-97f7-f9f3a1e19d94 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:38.627935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 573/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:26:38 2022] GET /identity/v3/role_assignments?user.id=85664ba6933247db98c11b9dec07aedb&scope.project.id=c166da4a3af34254831cc2084879c2ae&role.id=8595eaa9629b4ec4a628d662402fd25d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:40.653665 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873024-fede-4e08-b896-0ccd03523ce1 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:40.654220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873024-fede-4e08-b896-0ccd03523ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:40.654220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873024-fede-4e08-b896-0ccd03523ce1 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:40.655541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 558/1131] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:40.660671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f837698-5080-4129-9168-817d00ef7782 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:40.661326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f837698-5080-4129-9168-817d00ef7782 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:40.661475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f837698-5080-4129-9168-817d00ef7782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:40.681284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-3f837698-5080-4129-9168-817d00ef7782 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:40.682880 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3f837698-5080-4129-9168-817d00ef7782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:40.750302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 574/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:40.774418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06873024-fede-4e08-b896-0ccd03523ce1 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:40.830958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:40.873883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06873024-fede-4e08-b896-0ccd03523ce1 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:40.907047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c036f-c09d-4a2d-b8d3-8f72236c2b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:40.907613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c036f-c09d-4a2d-b8d3-8f72236c2b4a None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:40.907927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c036f-c09d-4a2d-b8d3-8f72236c2b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:40.908204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c036f-c09d-4a2d-b8d3-8f72236c2b4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:40.909354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c036f-c09d-4a2d-b8d3-8f72236c2b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:40.910768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c036f-c09d-4a2d-b8d3-8f72236c2b4a None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:40.912619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 559/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:40.918617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f837698-5080-4129-9168-817d00ef7782 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:40.926857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:41.018571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f837698-5080-4129-9168-817d00ef7782 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:41.051545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174e5cb-cbf6-41ba-a8e8-9f307cb01723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:41.052184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174e5cb-cbf6-41ba-a8e8-9f307cb01723 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:41.052469 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174e5cb-cbf6-41ba-a8e8-9f307cb01723 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:41.052744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174e5cb-cbf6-41ba-a8e8-9f307cb01723 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:41.053437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174e5cb-cbf6-41ba-a8e8-9f307cb01723 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:41.054895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174e5cb-cbf6-41ba-a8e8-9f307cb01723 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:41.154595 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 575/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 21:26:40 2022] POST /identity/v3/projects => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:26:43.165906 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6861fb-05f0-46aa-b6b4-1dd1b76ce340 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:43.166466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6861fb-05f0-46aa-b6b4-1dd1b76ce340 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:43.166466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6861fb-05f0-46aa-b6b4-1dd1b76ce340 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:43.167792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 560/1135] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:43.172842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be4f7-fa2d-4ec6-ab70-7421ce7bbec1 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:43.173217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be4f7-fa2d-4ec6-ab70-7421ce7bbec1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:43.173400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be4f7-fa2d-4ec6-ab70-7421ce7bbec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:43.191933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d81be4f7-fa2d-4ec6-ab70-7421ce7bbec1 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:43.193119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d81be4f7-fa2d-4ec6-ab70-7421ce7bbec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:43.245419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:43.259328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 576/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:43.283973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6861fb-05f0-46aa-b6b4-1dd1b76ce340 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:43.383292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6861fb-05f0-46aa-b6b4-1dd1b76ce340 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:43.406130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:43.416635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befe7e8-120c-41a9-8e26-adbb13db10a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:43.417205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befe7e8-120c-41a9-8e26-adbb13db10a3 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:43.417486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befe7e8-120c-41a9-8e26-adbb13db10a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:43.417758 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befe7e8-120c-41a9-8e26-adbb13db10a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:43.418910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befe7e8-120c-41a9-8e26-adbb13db10a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:43.420365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befe7e8-120c-41a9-8e26-adbb13db10a3 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:43.422642 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 561/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:26:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:43.428647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81be4f7-fa2d-4ec6-ab70-7421ce7bbec1 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:43.524549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81be4f7-fa2d-4ec6-ab70-7421ce7bbec1 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:43.557436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91957f-04fb-4b2c-8d48-db3510288523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:43.559000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91957f-04fb-4b2c-8d48-db3510288523 None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:43.559000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91957f-04fb-4b2c-8d48-db3510288523 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:43.559000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91957f-04fb-4b2c-8d48-db3510288523 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:43.559287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91957f-04fb-4b2c-8d48-db3510288523 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:43.560744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91957f-04fb-4b2c-8d48-db3510288523 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:43.650868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 577/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:26:43 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:26:45.676229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7e135-ef9e-4522-b75d-895f3b191f86 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:45.676792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7e135-ef9e-4522-b75d-895f3b191f86 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:45.676792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7e135-ef9e-4522-b75d-895f3b191f86 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:45.678097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 562/1139] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:45.683199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de6492-012c-4513-a136-1a704ea5f658 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:45.683577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de6492-012c-4513-a136-1a704ea5f658 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:45.683886 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de6492-012c-4513-a136-1a704ea5f658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:45.701649 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f3de6492-012c-4513-a136-1a704ea5f658 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:45.703393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f3de6492-012c-4513-a136-1a704ea5f658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:45.742908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:45.769522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 578/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:45.792881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7e135-ef9e-4522-b75d-895f3b191f86 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:45.891147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7e135-ef9e-4522-b75d-895f3b191f86 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:45.924007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9a1da-69ba-47d5-a55b-1977df5e9607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:45.924637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9a1da-69ba-47d5-a55b-1977df5e9607 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:45.924925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9a1da-69ba-47d5-a55b-1977df5e9607 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:45.925202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9a1da-69ba-47d5-a55b-1977df5e9607 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:45.935020 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9a1da-69ba-47d5-a55b-1977df5e9607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-83e9a1da-69ba-47d5-a55b-1977df5e9607 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:26:45.940781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:45.942024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:45.943183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:45.943183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:45.943183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:45.943183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:45.943183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:26:45.943183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:26:45.943183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:26:45.943183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:26:45.943183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:26:45.943183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:26:45.943183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:26:45.943183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:45.943183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 563/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:26:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:26:45.948368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de6492-012c-4513-a136-1a704ea5f658 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:46.044613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de6492-012c-4513-a136-1a704ea5f658 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:46.077181 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404d9f5-fc49-41c7-890e-b5aabb7b5b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:46.078075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404d9f5-fc49-41c7-890e-b5aabb7b5b2d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:46.078361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404d9f5-fc49-41c7-890e-b5aabb7b5b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:46.078637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404d9f5-fc49-41c7-890e-b5aabb7b5b2d None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:46.079354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404d9f5-fc49-41c7-890e-b5aabb7b5b2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:46.079663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404d9f5-fc49-41c7-890e-b5aabb7b5b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:46.081057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404d9f5-fc49-41c7-890e-b5aabb7b5b2d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:46.088927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 579/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:26:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:46.095303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9a1da-69ba-47d5-a55b-1977df5e9607 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:46.147362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:46.193935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9a1da-69ba-47d5-a55b-1977df5e9607 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:46.226701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14364b6-aba1-48a9-8f79-d6323d09d4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:46.227328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14364b6-aba1-48a9-8f79-d6323d09d4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:46.227613 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14364b6-aba1-48a9-8f79-d6323d09d4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:46.227926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14364b6-aba1-48a9-8f79-d6323d09d4a8 None admin] PATH_INFO: `/v3/users/32581c80c914495caa2d674293b06e7d` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:46.240471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14364b6-aba1-48a9-8f79-d6323d09d4a8 None admin] RBAC: Authorizing `identity:get_user(user_id=32581c80c914495caa2d674293b06e7d)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:46.241904 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14364b6-aba1-48a9-8f79-d6323d09d4a8 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:46.243497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 564/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:26:46 2022] GET /identity/v3/users/32581c80c914495caa2d674293b06e7d => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:46.249354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404d9f5-fc49-41c7-890e-b5aabb7b5b2d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:46.284779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:46.348777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404d9f5-fc49-41c7-890e-b5aabb7b5b2d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:46.381894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135aec94-ea7e-410a-b4ae-87461bf7e3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:46.382498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aec94-ea7e-410a-b4ae-87461bf7e3ea None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:46.382780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aec94-ea7e-410a-b4ae-87461bf7e3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:46.383056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aec94-ea7e-410a-b4ae-87461bf7e3ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:46.449244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135aec94-ea7e-410a-b4ae-87461bf7e3ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:46.450637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135aec94-ea7e-410a-b4ae-87461bf7e3ea None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:46.482233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:46.547178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 580/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:26:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:26:46.553091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14364b6-aba1-48a9-8f79-d6323d09d4a8 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:46.652058 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14364b6-aba1-48a9-8f79-d6323d09d4a8 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:46.663443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:46.686650 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc4ff9-8900-42bf-a485-431911ec6389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:46.687521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc4ff9-8900-42bf-a485-431911ec6389 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:46.687798 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc4ff9-8900-42bf-a485-431911ec6389 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:46.688079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc4ff9-8900-42bf-a485-431911ec6389 None admin] PATH_INFO: `/v3/projects/3c6808f94f7d485aa6c83904f9df792c` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:46.689302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc4ff9-8900-42bf-a485-431911ec6389 None admin] RBAC: Authorizing `identity:get_project(project_id=3c6808f94f7d485aa6c83904f9df792c)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:46.690850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc4ff9-8900-42bf-a485-431911ec6389 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:46.693984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 565/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:26:46 2022] GET /identity/v3/projects/3c6808f94f7d485aa6c83904f9df792c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:46.698843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135aec94-ea7e-410a-b4ae-87461bf7e3ea None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:46.797498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135aec94-ea7e-410a-b4ae-87461bf7e3ea None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:46.829854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601cbe0-a83d-4ea0-9e17-a7e90908d053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:46.830459 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601cbe0-a83d-4ea0-9e17-a7e90908d053 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:46.830743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601cbe0-a83d-4ea0-9e17-a7e90908d053 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:46.831018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601cbe0-a83d-4ea0-9e17-a7e90908d053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:46.831833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601cbe0-a83d-4ea0-9e17-a7e90908d053 None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=3c6808f94f7d485aa6c83904f9df792c, user.id=32581c80c914495caa2d674293b06e7d) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:46.832145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601cbe0-a83d-4ea0-9e17-a7e90908d053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:46.833574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601cbe0-a83d-4ea0-9e17-a7e90908d053 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:46.836378 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:46.839214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 581/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:26:46 2022] GET /identity/v3/role_assignments?user.id=32581c80c914495caa2d674293b06e7d&scope.project.id=3c6808f94f7d485aa6c83904f9df792c&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:48.800875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223195c-9633-4558-990f-610a29238f0e None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:48.801417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223195c-9633-4558-990f-610a29238f0e None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:48.801417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223195c-9633-4558-990f-610a29238f0e None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:48.802763 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 566/1147] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:48.807845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5187d-06db-493c-b799-b71a9b98ce23 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:48.808211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5187d-06db-493c-b799-b71a9b98ce23 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:48.808399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5187d-06db-493c-b799-b71a9b98ce23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:48.826771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a0f5187d-06db-493c-b799-b71a9b98ce23 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:48.828076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a0f5187d-06db-493c-b799-b71a9b98ce23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:48.893588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 582/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:48.915960 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223195c-9633-4558-990f-610a29238f0e None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:49.013855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223195c-9633-4558-990f-610a29238f0e None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:49.047463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6496a-f7b9-459a-afa1-de3bd026c082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:49.048115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6496a-f7b9-459a-afa1-de3bd026c082 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:49.048399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6496a-f7b9-459a-afa1-de3bd026c082 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:49.048676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6496a-f7b9-459a-afa1-de3bd026c082 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:49.058363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6496a-f7b9-459a-afa1-de3bd026c082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-f0b6496a-f7b9-459a-afa1-de3bd026c082 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:26:49.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:49.064587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:49.065619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:49.065619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:49.065619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:49.065619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:49.065619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:26:49.065619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:26:49.065619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:26:49.065619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:26:49.065619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:26:49.065619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:26:49.065619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:26:49.065619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:49.065619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 567/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:26:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:49.070526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5187d-06db-493c-b799-b71a9b98ce23 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:49.166461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5187d-06db-493c-b799-b71a9b98ce23 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:49.194554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:49.199977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae0388-baed-4e83-b670-335647c69aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:49.200588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae0388-baed-4e83-b670-335647c69aba None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:49.200872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae0388-baed-4e83-b670-335647c69aba None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:49.201147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae0388-baed-4e83-b670-335647c69aba None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:49.201859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae0388-baed-4e83-b670-335647c69aba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:49.202716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae0388-baed-4e83-b670-335647c69aba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:49.204275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae0388-baed-4e83-b670-335647c69aba None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:49.212027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 583/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:26:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:49.217828 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6496a-f7b9-459a-afa1-de3bd026c082 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:49.257718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:49.318240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6496a-f7b9-459a-afa1-de3bd026c082 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:49.351245 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c134d-c268-4ce1-a0c5-984c1c03718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:49.351900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c134d-c268-4ce1-a0c5-984c1c03718d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:49.352182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c134d-c268-4ce1-a0c5-984c1c03718d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:49.352456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c134d-c268-4ce1-a0c5-984c1c03718d None admin] PATH_INFO: `/v3/users/32581c80c914495caa2d674293b06e7d` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:49.353619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c134d-c268-4ce1-a0c5-984c1c03718d None admin] RBAC: Authorizing `identity:get_user(user_id=32581c80c914495caa2d674293b06e7d)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:49.355023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c134d-c268-4ce1-a0c5-984c1c03718d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:49.356618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 568/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:26:49 2022] GET /identity/v3/users/32581c80c914495caa2d674293b06e7d => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:49.363410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae0388-baed-4e83-b670-335647c69aba None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:49.462807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae0388-baed-4e83-b670-335647c69aba None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:49.495198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976ef8e-93c1-4048-b826-9c3ee41c840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:49.495851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976ef8e-93c1-4048-b826-9c3ee41c840c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:49.496136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976ef8e-93c1-4048-b826-9c3ee41c840c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:49.496412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976ef8e-93c1-4048-b826-9c3ee41c840c None admin] PATH_INFO: `/v3/projects/3c6808f94f7d485aa6c83904f9df792c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:49.497555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976ef8e-93c1-4048-b826-9c3ee41c840c None admin] RBAC: Authorizing `identity:get_project(project_id=3c6808f94f7d485aa6c83904f9df792c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:49.498978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976ef8e-93c1-4048-b826-9c3ee41c840c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:49.501435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 584/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:26:49 2022] GET /identity/v3/projects/3c6808f94f7d485aa6c83904f9df792c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:49.507281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c134d-c268-4ce1-a0c5-984c1c03718d None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:49.604481 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c134d-c268-4ce1-a0c5-984c1c03718d None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:49.611628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:49.639055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636550c5-cd2f-4405-a1a3-2fd811be5d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:49.639809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636550c5-cd2f-4405-a1a3-2fd811be5d7e None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:49.640399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636550c5-cd2f-4405-a1a3-2fd811be5d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:49.640686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636550c5-cd2f-4405-a1a3-2fd811be5d7e None admin] PATH_INFO: `/v3/projects/3c6808f94f7d485aa6c83904f9df792c/users/32581c80c914495caa2d674293b06e7d/roles/11da9ce3f79148679dbde9eb2c568e55` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:49.642714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636550c5-cd2f-4405-a1a3-2fd811be5d7e None admin] RBAC: Authorizing `identity:create_grant(project_id=3c6808f94f7d485aa6c83904f9df792c, user_id=32581c80c914495caa2d674293b06e7d, role_id=11da9ce3f79148679dbde9eb2c568e55)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:49.644180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636550c5-cd2f-4405-a1a3-2fd811be5d7e None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:49.742303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 569/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:26:49 2022] PUT /identity/v3/projects/3c6808f94f7d485aa6c83904f9df792c/users/32581c80c914495caa2d674293b06e7d/roles/11da9ce3f79148679dbde9eb2c568e55 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:26:51.747877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe847-13fa-43dd-ba71-a6e400ec4574 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:51.748389 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe847-13fa-43dd-ba71-a6e400ec4574 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:51.748494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe847-13fa-43dd-ba71-a6e400ec4574 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:51.749832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 585/1154] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:51.755580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57bab0-d92b-4328-812b-d58c1b301ac0 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:51.756053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57bab0-d92b-4328-812b-d58c1b301ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:51.756153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57bab0-d92b-4328-812b-d58c1b301ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:51.774746 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-2b57bab0-d92b-4328-812b-d58c1b301ac0 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:51.775975 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-2b57bab0-d92b-4328-812b-d58c1b301ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:51.843895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 570/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:51.867208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fe847-13fa-43dd-ba71-a6e400ec4574 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:51.927437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:51.968615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fe847-13fa-43dd-ba71-a6e400ec4574 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:52.001642 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb4885-8caa-4b32-808d-3041679e2a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:52.002273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb4885-8caa-4b32-808d-3041679e2a79 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:52.002557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb4885-8caa-4b32-808d-3041679e2a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:52.002832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb4885-8caa-4b32-808d-3041679e2a79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:52.013351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb4885-8caa-4b32-808d-3041679e2a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-95cb4885-8caa-4b32-808d-3041679e2a79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:26:52.018326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:52.019424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:52.020688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:52.020688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:52.020688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:52.020688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:52.020688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:26:52.020688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:26:52.020688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:26:52.020688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:26:52.020688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:26:52.020688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:26:52.020688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:26:52.020688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:26:52.020688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 586/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:26:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:52.025842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57bab0-d92b-4328-812b-d58c1b301ac0 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:52.118541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:52.124191 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57bab0-d92b-4328-812b-d58c1b301ac0 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:52.163205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b7855-67be-456b-a656-4258f1213c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:52.163840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b7855-67be-456b-a656-4258f1213c0d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:52.164126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b7855-67be-456b-a656-4258f1213c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:52.164403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b7855-67be-456b-a656-4258f1213c0d None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:52.165119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b7855-67be-456b-a656-4258f1213c0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:52.165435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b7855-67be-456b-a656-4258f1213c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:52.166828 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b7855-67be-456b-a656-4258f1213c0d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:52.181077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 571/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:26:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:52.182404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb4885-8caa-4b32-808d-3041679e2a79 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:52.281755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb4885-8caa-4b32-808d-3041679e2a79 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:52.301338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:52.315700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2c7c-25bc-44ee-90a4-275589ce9b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:52.316365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2c7c-25bc-44ee-90a4-275589ce9b7e None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:52.316652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2c7c-25bc-44ee-90a4-275589ce9b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:52.316932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2c7c-25bc-44ee-90a4-275589ce9b7e None admin] PATH_INFO: `/v3/users/32581c80c914495caa2d674293b06e7d` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:52.318099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca2c7c-25bc-44ee-90a4-275589ce9b7e None admin] RBAC: Authorizing `identity:get_user(user_id=32581c80c914495caa2d674293b06e7d)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:52.319528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca2c7c-25bc-44ee-90a4-275589ce9b7e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:52.321160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 587/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:26:52 2022] GET /identity/v3/users/32581c80c914495caa2d674293b06e7d => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:52.326945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b7855-67be-456b-a656-4258f1213c0d None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:52.423536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b7855-67be-456b-a656-4258f1213c0d None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:52.456286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b399ec-d77c-4d04-9991-769e437b5278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:52.456895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b399ec-d77c-4d04-9991-769e437b5278 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:52.457176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b399ec-d77c-4d04-9991-769e437b5278 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:52.457451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b399ec-d77c-4d04-9991-769e437b5278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:52.483009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:52.522773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b399ec-d77c-4d04-9991-769e437b5278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:52.524239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b399ec-d77c-4d04-9991-769e437b5278 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:52.620968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 572/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:26:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:26:52.627491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2c7c-25bc-44ee-90a4-275589ce9b7e None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:52.727208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2c7c-25bc-44ee-90a4-275589ce9b7e None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:52.759871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb5585-7073-4011-9243-b253d5aed940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:52.760515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb5585-7073-4011-9243-b253d5aed940 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:52.760790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb5585-7073-4011-9243-b253d5aed940 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:52.761065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb5585-7073-4011-9243-b253d5aed940 None admin] PATH_INFO: `/v3/projects/3c6808f94f7d485aa6c83904f9df792c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:52.762230 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb5585-7073-4011-9243-b253d5aed940 None admin] RBAC: Authorizing `identity:get_project(project_id=3c6808f94f7d485aa6c83904f9df792c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:52.763660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb5585-7073-4011-9243-b253d5aed940 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:52.765910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 588/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:26:52 2022] GET /identity/v3/projects/3c6808f94f7d485aa6c83904f9df792c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:52.772140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b399ec-d77c-4d04-9991-769e437b5278 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:52.829823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:52.869689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b399ec-d77c-4d04-9991-769e437b5278 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:52.903329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379a258-f1df-4a26-b98d-e0aece143632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:52.903904 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379a258-f1df-4a26-b98d-e0aece143632 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:52.904185 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379a258-f1df-4a26-b98d-e0aece143632 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:52.904455 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379a258-f1df-4a26-b98d-e0aece143632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:52.905393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379a258-f1df-4a26-b98d-e0aece143632 None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=3c6808f94f7d485aa6c83904f9df792c, user.id=32581c80c914495caa2d674293b06e7d) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:52.906013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379a258-f1df-4a26-b98d-e0aece143632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:52.907433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379a258-f1df-4a26-b98d-e0aece143632 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:52.913261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 573/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:26:52 2022] GET /identity/v3/role_assignments?user.id=32581c80c914495caa2d674293b06e7d&scope.project.id=3c6808f94f7d485aa6c83904f9df792c&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:26:54.940155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48577ff6-69eb-4299-861a-59a3441dceb0 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:54.940673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48577ff6-69eb-4299-861a-59a3441dceb0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:54.940762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48577ff6-69eb-4299-861a-59a3441dceb0 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:54.942060 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 589/1162] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:54.947186 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7537120-f453-4930-9705-1060791acb67 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:54.947558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7537120-f453-4930-9705-1060791acb67 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:54.947692 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7537120-f453-4930-9705-1060791acb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:54.965568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-d7537120-f453-4930-9705-1060791acb67 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:54.966747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-d7537120-f453-4930-9705-1060791acb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:55.032958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 574/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:55.056142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48577ff6-69eb-4299-861a-59a3441dceb0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:55.112730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:55.155551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48577ff6-69eb-4299-861a-59a3441dceb0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:55.188598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58623df3-d8c5-473d-a694-7cdc101caecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:55.189204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58623df3-d8c5-473d-a694-7cdc101caecf None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:55.189487 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58623df3-d8c5-473d-a694-7cdc101caecf None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:55.189759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58623df3-d8c5-473d-a694-7cdc101caecf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:55.254833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58623df3-d8c5-473d-a694-7cdc101caecf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:55.256306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58623df3-d8c5-473d-a694-7cdc101caecf None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:55.308053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:55.352236 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 590/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:26:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:26:55.358192 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7537120-f453-4930-9705-1060791acb67 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:55.408724 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:55.454006 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7537120-f453-4930-9705-1060791acb67 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:55.486309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103e26e-8bad-4d3b-9997-6fbc2e4cf332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:55.486940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103e26e-8bad-4d3b-9997-6fbc2e4cf332 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:55.487223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103e26e-8bad-4d3b-9997-6fbc2e4cf332 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:55.487501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103e26e-8bad-4d3b-9997-6fbc2e4cf332 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:55.494015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103e26e-8bad-4d3b-9997-6fbc2e4cf332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:55.495438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103e26e-8bad-4d3b-9997-6fbc2e4cf332 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-9103e26e-8bad-4d3b-9997-6fbc2e4cf332 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:26:55.506871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:26:55.508143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:26:55.509284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 575/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 21:26:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:26:55.513913 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58623df3-d8c5-473d-a694-7cdc101caecf None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:55.611187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58623df3-d8c5-473d-a694-7cdc101caecf None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:55.644479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb9951-77f3-4f9b-8464-ea4598be94b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:55.645077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9951-77f3-4f9b-8464-ea4598be94b2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:55.645358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9951-77f3-4f9b-8464-ea4598be94b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:55.645630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9951-77f3-4f9b-8464-ea4598be94b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:55.646314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb9951-77f3-4f9b-8464-ea4598be94b2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:26:55.646616 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb9951-77f3-4f9b-8464-ea4598be94b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:55.647992 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb9951-77f3-4f9b-8464-ea4598be94b2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:55.654868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 591/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 25 21:26:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:26:57.644057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d811-4030-450d-8e0a-dd1b26070820 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:57.644591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d811-4030-450d-8e0a-dd1b26070820 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:57.644591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d811-4030-450d-8e0a-dd1b26070820 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:57.645947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 576/1167] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:57.651095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b148c-a16c-4d48-9fd3-99c1460e6988 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:57.651515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b148c-a16c-4d48-9fd3-99c1460e6988 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:57.651644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b148c-a16c-4d48-9fd3-99c1460e6988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:57.670226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f53b148c-a16c-4d48-9fd3-99c1460e6988 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:26:57.671454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f53b148c-a16c-4d48-9fd3-99c1460e6988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:26:57.685377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:57.740712 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 592/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:26:57.763055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5d811-4030-450d-8e0a-dd1b26070820 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:26:57.863133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5d811-4030-450d-8e0a-dd1b26070820 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:26:57.876352 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:26:57.896992 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1da56-ec46-440e-9a52-cfac290a378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:26:57.897529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1da56-ec46-440e-9a52-cfac290a378c None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:57.897928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1da56-ec46-440e-9a52-cfac290a378c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:57.898205 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1da56-ec46-440e-9a52-cfac290a378c None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:57.898907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1da56-ec46-440e-9a52-cfac290a378c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:26:57.900287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1da56-ec46-440e-9a52-cfac290a378c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:26:57.960648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 577/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Mon Jul 25 21:26:57 2022] POST /identity/v3/domains => generated 267 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:26:59.984335 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efca886-0a3a-4e58-8cb5-07dd29705023 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:59.984882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efca886-0a3a-4e58-8cb5-07dd29705023 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:59.984882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efca886-0a3a-4e58-8cb5-07dd29705023 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:26:59.986164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 593/1170] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:26:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:26:59.991304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835b763-4d0b-44e1-a82f-b82473f2f9ce None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:26:59.991789 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835b763-4d0b-44e1-a82f-b82473f2f9ce None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:26:59.991892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835b763-4d0b-44e1-a82f-b82473f2f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:00.010646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-0835b763-4d0b-44e1-a82f-b82473f2f9ce None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:00.011866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-0835b763-4d0b-44e1-a82f-b82473f2f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:00.076360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 578/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:26:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:27:00.099704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efca886-0a3a-4e58-8cb5-07dd29705023 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:00.199228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efca886-0a3a-4e58-8cb5-07dd29705023 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:00.232483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce6404-cfe7-4e2a-9803-245f5cd74500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:00.233741 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce6404-cfe7-4e2a-9803-245f5cd74500 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:00.234063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce6404-cfe7-4e2a-9803-245f5cd74500 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:00.234394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce6404-cfe7-4e2a-9803-245f5cd74500 None admin] PATH_INFO: `/v3/domains/d8efb70b08e4429ca23775e39c2d592d` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:00.244464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce6404-cfe7-4e2a-9803-245f5cd74500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d8efb70b08e4429ca23775e39c2d592d)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:00.245908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce6404-cfe7-4e2a-9803-245f5cd74500 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:00.247481 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 594/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Mon Jul 25 21:27:00 2022] GET /identity/v3/domains/d8efb70b08e4429ca23775e39c2d592d => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:27:00.253496 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835b763-4d0b-44e1-a82f-b82473f2f9ce None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:00.348283 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835b763-4d0b-44e1-a82f-b82473f2f9ce None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:00.349773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:00.382482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf5cf9-82fc-4424-af23-cd223209b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:00.383098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf5cf9-82fc-4424-af23-cd223209b587 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:00.383383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf5cf9-82fc-4424-af23-cd223209b587 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:00.383659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf5cf9-82fc-4424-af23-cd223209b587 None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:00.384461 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf5cf9-82fc-4424-af23-cd223209b587 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:00.385956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf5cf9-82fc-4424-af23-cd223209b587 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:00.444805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 579/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 21:27:00 2022] POST /identity/v3/projects => generated 361 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:27:02.491426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e5b25-4d4e-42a0-9232-ae433436004a None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:02.492018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e5b25-4d4e-42a0-9232-ae433436004a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:02.492018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e5b25-4d4e-42a0-9232-ae433436004a None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:02.493376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 595/1174] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:02.498435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4887f-0ad6-4e04-81e2-e28b9033a06f None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:02.499467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4887f-0ad6-4e04-81e2-e28b9033a06f None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:02.499637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4887f-0ad6-4e04-81e2-e28b9033a06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:02.518048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-a1c4887f-0ad6-4e04-81e2-e28b9033a06f None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:02.519234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-a1c4887f-0ad6-4e04-81e2-e28b9033a06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:02.584173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 580/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:27:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:27:02.608858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e5b25-4d4e-42a0-9232-ae433436004a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:02.622444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:02.712618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e5b25-4d4e-42a0-9232-ae433436004a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:02.746244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb5ca6-6005-4ca7-bb19-943d9628d6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:02.746808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5ca6-6005-4ca7-bb19-943d9628d6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:02.747092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5ca6-6005-4ca7-bb19-943d9628d6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:02.747370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb5ca6-6005-4ca7-bb19-943d9628d6d9 None admin] PATH_INFO: `/v3/domains/d8efb70b08e4429ca23775e39c2d592d` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:02.749123 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb5ca6-6005-4ca7-bb19-943d9628d6d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d8efb70b08e4429ca23775e39c2d592d)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:02.750561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb5ca6-6005-4ca7-bb19-943d9628d6d9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:02.752191 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 596/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Mon Jul 25 21:27:02 2022] GET /identity/v3/domains/d8efb70b08e4429ca23775e39c2d592d => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:27:02.758216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4887f-0ad6-4e04-81e2-e28b9033a06f None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:02.839003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:02.854024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4887f-0ad6-4e04-81e2-e28b9033a06f None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:02.886952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37134d-eeee-4e27-8e2f-04a0e4bb21d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:02.887560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37134d-eeee-4e27-8e2f-04a0e4bb21d3 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:02.887872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37134d-eeee-4e27-8e2f-04a0e4bb21d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:02.888147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37134d-eeee-4e27-8e2f-04a0e4bb21d3 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:02.888832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37134d-eeee-4e27-8e2f-04a0e4bb21d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:02.890388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37134d-eeee-4e27-8e2f-04a0e4bb21d3 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:02.969356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 581/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:27:02 2022] POST /identity/v3/users => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:27:05.045927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c7b55-0d4a-45d3-b7a7-90e43d000e71 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:05.046477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c7b55-0d4a-45d3-b7a7-90e43d000e71 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:05.046477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c7b55-0d4a-45d3-b7a7-90e43d000e71 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:05.047857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 597/1178] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:05.052926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bceba-f033-4593-b88a-d660abc49fb3 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:05.053358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bceba-f033-4593-b88a-d660abc49fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:05.053483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bceba-f033-4593-b88a-d660abc49fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:05.071016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-ac5bceba-f033-4593-b88a-d660abc49fb3 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:05.072238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-ac5bceba-f033-4593-b88a-d660abc49fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:05.136512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 582/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:27:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:27:05.160948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c7b55-0d4a-45d3-b7a7-90e43d000e71 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:05.238792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:05.260141 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c7b55-0d4a-45d3-b7a7-90e43d000e71 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:05.294353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2133798-89bf-4c2c-9301-131420918baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:05.294985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2133798-89bf-4c2c-9301-131420918baf None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:05.295300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2133798-89bf-4c2c-9301-131420918baf None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:05.295582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2133798-89bf-4c2c-9301-131420918baf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:05.305426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2133798-89bf-4c2c-9301-131420918baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b2133798-89bf-4c2c-9301-131420918baf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:27:05.310251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:27:05.311354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:27:05.312294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:27:05.312294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:27:05.312294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:27:05.312294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:27:05.312294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:27:05.312294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:27:05.312294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:27:05.312294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:27:05.312294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:27:05.312294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:27:05.312294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:27:05.312294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:27:05.312294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 598/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:27:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:27:05.317446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bceba-f033-4593-b88a-d660abc49fb3 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:05.384080 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:05.414289 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bceba-f033-4593-b88a-d660abc49fb3 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:05.448498 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62097727-ae1a-4072-b69e-8978caa7c501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:05.449110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097727-ae1a-4072-b69e-8978caa7c501 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:05.449390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097727-ae1a-4072-b69e-8978caa7c501 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:05.449664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097727-ae1a-4072-b69e-8978caa7c501 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:05.450370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62097727-ae1a-4072-b69e-8978caa7c501 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:27:05.450671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62097727-ae1a-4072-b69e-8978caa7c501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:05.452747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62097727-ae1a-4072-b69e-8978caa7c501 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:05.460659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 583/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:27:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:27:05.466699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2133798-89bf-4c2c-9301-131420918baf None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:05.567008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2133798-89bf-4c2c-9301-131420918baf None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:05.600146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca86fac-6e58-446c-ba8a-018518a300bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:05.600773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca86fac-6e58-446c-ba8a-018518a300bc None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:05.601055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca86fac-6e58-446c-ba8a-018518a300bc None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:05.601328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca86fac-6e58-446c-ba8a-018518a300bc None admin] PATH_INFO: `/v3/users/87b6c038784a44398d12e4c0bb147f34` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:05.648072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:05.653669 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca86fac-6e58-446c-ba8a-018518a300bc None admin] RBAC: Authorizing `identity:get_user(user_id=87b6c038784a44398d12e4c0bb147f34)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:05.655824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca86fac-6e58-446c-ba8a-018518a300bc None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:05.657475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 599/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:27:05 2022] GET /identity/v3/users/87b6c038784a44398d12e4c0bb147f34 => generated 311 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:27:05.663624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62097727-ae1a-4072-b69e-8978caa7c501 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:05.761851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62097727-ae1a-4072-b69e-8978caa7c501 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:05.790737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:05.795660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6b5ef-4a2b-4c24-af4c-b58954348069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:05.796309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b5ef-4a2b-4c24-af4c-b58954348069 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:05.796592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b5ef-4a2b-4c24-af4c-b58954348069 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:05.796866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b5ef-4a2b-4c24-af4c-b58954348069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:05.862827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6b5ef-4a2b-4c24-af4c-b58954348069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:05.864214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6b5ef-4a2b-4c24-af4c-b58954348069 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:05.959847 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 584/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:27:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:27:05.965661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca86fac-6e58-446c-ba8a-018518a300bc None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:06.075983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca86fac-6e58-446c-ba8a-018518a300bc None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:06.110442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1051b5a-a412-4c9b-b3bb-6232e5cdcae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:06.111071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1051b5a-a412-4c9b-b3bb-6232e5cdcae3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:06.111351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1051b5a-a412-4c9b-b3bb-6232e5cdcae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:06.111618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1051b5a-a412-4c9b-b3bb-6232e5cdcae3 None admin] PATH_INFO: `/v3/projects/3ad856aec76f4486895543fbb42d07e0` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:06.112798 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1051b5a-a412-4c9b-b3bb-6232e5cdcae3 None admin] RBAC: Authorizing `identity:get_project(project_id=3ad856aec76f4486895543fbb42d07e0)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:06.114257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1051b5a-a412-4c9b-b3bb-6232e5cdcae3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:06.115861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 600/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:27:05 2022] GET /identity/v3/projects/3ad856aec76f4486895543fbb42d07e0 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:27:06.121953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6b5ef-4a2b-4c24-af4c-b58954348069 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:06.151343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:06.218458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6b5ef-4a2b-4c24-af4c-b58954348069 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:06.251312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c707ea-f328-4783-92e5-d74ef54a50e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:06.251939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c707ea-f328-4783-92e5-d74ef54a50e3 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:06.252225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c707ea-f328-4783-92e5-d74ef54a50e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:06.252500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c707ea-f328-4783-92e5-d74ef54a50e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:06.253286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c707ea-f328-4783-92e5-d74ef54a50e3 None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=3ad856aec76f4486895543fbb42d07e0, user.id=87b6c038784a44398d12e4c0bb147f34) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:27:06.253593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c707ea-f328-4783-92e5-d74ef54a50e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:06.255001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c707ea-f328-4783-92e5-d74ef54a50e3 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:06.260268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 585/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:27:06 2022] GET /identity/v3/role_assignments?user.id=87b6c038784a44398d12e4c0bb147f34&scope.project.id=3ad856aec76f4486895543fbb42d07e0&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:27:08.229256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a022ec-c622-43fd-a4c9-3f6eacc7aee9 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:08.229825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a022ec-c622-43fd-a4c9-3f6eacc7aee9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:08.229825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a022ec-c622-43fd-a4c9-3f6eacc7aee9 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:08.231153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 601/1186] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:08.236568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541951a-be8d-4fab-8abf-1e7de82a1996 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:08.236997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541951a-be8d-4fab-8abf-1e7de82a1996 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:08.237098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541951a-be8d-4fab-8abf-1e7de82a1996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:08.255130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-b541951a-be8d-4fab-8abf-1e7de82a1996 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:08.256325 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-b541951a-be8d-4fab-8abf-1e7de82a1996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:08.321385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 586/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:27:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:27:08.344331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a022ec-c622-43fd-a4c9-3f6eacc7aee9 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:08.406021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:08.443029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a022ec-c622-43fd-a4c9-3f6eacc7aee9 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:08.476197 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3149ac-ea22-46b7-97f8-f8972547242d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:08.476824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3149ac-ea22-46b7-97f8-f8972547242d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:08.477107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3149ac-ea22-46b7-97f8-f8972547242d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:08.477378 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3149ac-ea22-46b7-97f8-f8972547242d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:08.487594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3149ac-ea22-46b7-97f8-f8972547242d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-2f3149ac-ea22-46b7-97f8-f8972547242d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:27:08.492363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:27:08.493434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:27:08.494337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:27:08.494337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:27:08.494337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:27:08.494337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:27:08.494337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:27:08.494337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:27:08.494337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:27:08.494337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:27:08.494337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:27:08.494337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:27:08.494337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:27:08.494337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:27:08.494337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 602/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:27:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:27:08.500214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541951a-be8d-4fab-8abf-1e7de82a1996 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:08.526444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:08.597894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541951a-be8d-4fab-8abf-1e7de82a1996 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:08.632036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3201830-f483-4394-9189-e9b32cc2af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:08.632645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3201830-f483-4394-9189-e9b32cc2af38 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:08.632923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3201830-f483-4394-9189-e9b32cc2af38 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:08.633188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3201830-f483-4394-9189-e9b32cc2af38 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:08.633881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3201830-f483-4394-9189-e9b32cc2af38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:27:08.634180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3201830-f483-4394-9189-e9b32cc2af38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:08.635531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3201830-f483-4394-9189-e9b32cc2af38 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:08.644099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 587/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:27:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:27:08.649935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3149ac-ea22-46b7-97f8-f8972547242d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:08.750007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3149ac-ea22-46b7-97f8-f8972547242d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:08.772866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:08.784546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55aa64-1e4b-4db0-9f3a-6b52d9bb2484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:08.785226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55aa64-1e4b-4db0-9f3a-6b52d9bb2484 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:08.785462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55aa64-1e4b-4db0-9f3a-6b52d9bb2484 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:08.785988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55aa64-1e4b-4db0-9f3a-6b52d9bb2484 None admin] PATH_INFO: `/v3/users/87b6c038784a44398d12e4c0bb147f34` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:08.787147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55aa64-1e4b-4db0-9f3a-6b52d9bb2484 None admin] RBAC: Authorizing `identity:get_user(user_id=87b6c038784a44398d12e4c0bb147f34)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:08.788611 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55aa64-1e4b-4db0-9f3a-6b52d9bb2484 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:08.790206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 603/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:27:08 2022] GET /identity/v3/users/87b6c038784a44398d12e4c0bb147f34 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:27:08.796056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3201830-f483-4394-9189-e9b32cc2af38 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:08.882480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:08.894391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3201830-f483-4394-9189-e9b32cc2af38 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:08.927953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d4e89-dc79-48e5-b8e9-a73f436ab9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:08.928590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d4e89-dc79-48e5-b8e9-a73f436ab9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:08.928873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d4e89-dc79-48e5-b8e9-a73f436ab9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:08.929149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d4e89-dc79-48e5-b8e9-a73f436ab9e9 None admin] PATH_INFO: `/v3/projects/3ad856aec76f4486895543fbb42d07e0` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:08.930298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d4e89-dc79-48e5-b8e9-a73f436ab9e9 None admin] RBAC: Authorizing `identity:get_project(project_id=3ad856aec76f4486895543fbb42d07e0)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:08.931721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d4e89-dc79-48e5-b8e9-a73f436ab9e9 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:08.933383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 588/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:27:08 2022] GET /identity/v3/projects/3ad856aec76f4486895543fbb42d07e0 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:27:08.940024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55aa64-1e4b-4db0-9f3a-6b52d9bb2484 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:09.036092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55aa64-1e4b-4db0-9f3a-6b52d9bb2484 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:09.069560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9607c-cad8-4c51-a9ce-dd8ad4dab049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:09.070217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9607c-cad8-4c51-a9ce-dd8ad4dab049 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:09.070499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9607c-cad8-4c51-a9ce-dd8ad4dab049 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:09.070771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9607c-cad8-4c51-a9ce-dd8ad4dab049 None admin] PATH_INFO: `/v3/projects/3ad856aec76f4486895543fbb42d07e0/users/87b6c038784a44398d12e4c0bb147f34/roles/11da9ce3f79148679dbde9eb2c568e55` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:09.072723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9607c-cad8-4c51-a9ce-dd8ad4dab049 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad856aec76f4486895543fbb42d07e0, user_id=87b6c038784a44398d12e4c0bb147f34, role_id=11da9ce3f79148679dbde9eb2c568e55)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:09.074146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9607c-cad8-4c51-a9ce-dd8ad4dab049 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:09.134726 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 604/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:27:08 2022] PUT /identity/v3/projects/3ad856aec76f4486895543fbb42d07e0/users/87b6c038784a44398d12e4c0bb147f34/roles/11da9ce3f79148679dbde9eb2c568e55 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:27:11.150156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda612-42a0-4bc9-9932-ac00a752f286 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:11.150706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda612-42a0-4bc9-9932-ac00a752f286 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:11.150706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fda612-42a0-4bc9-9932-ac00a752f286 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:11.152076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 589/1193] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:27:11.157928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c0d9-fa67-4edb-a86d-4b81e430a3b1 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:11.158338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c0d9-fa67-4edb-a86d-4b81e430a3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:11.158488 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31c0d9-fa67-4edb-a86d-4b81e430a3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:11.176541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-7a31c0d9-fa67-4edb-a86d-4b81e430a3b1 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:27:11.177722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7a31c0d9-fa67-4edb-a86d-4b81e430a3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:27:11.224282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:11.243116 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 605/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:27:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 21:27:11.266247 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fda612-42a0-4bc9-9932-ac00a752f286 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:11.365909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fda612-42a0-4bc9-9932-ac00a752f286 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:11.399215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb0a28-0a1b-4ed3-b2ad-caf09baa9220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:11.399883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb0a28-0a1b-4ed3-b2ad-caf09baa9220 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:11.400217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb0a28-0a1b-4ed3-b2ad-caf09baa9220 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:11.400447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb0a28-0a1b-4ed3-b2ad-caf09baa9220 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:11.410466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb0a28-0a1b-4ed3-b2ad-caf09baa9220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-3beb0a28-0a1b-4ed3-b2ad-caf09baa9220 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:27:11.415624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:27:11.416779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:27:11.417711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:27:11.417711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:27:11.417711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:27:11.417711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:27:11.417711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:27:11.417711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:27:11.417711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:27:11.417711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:27:11.417711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:27:11.417711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:27:11.417711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:27:11.417711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:27:11.417711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 590/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:27:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:27:11.422771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31c0d9-fa67-4edb-a86d-4b81e430a3b1 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:11.520328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31c0d9-fa67-4edb-a86d-4b81e430a3b1 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:11.553538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8baca-688d-4eab-8f70-f55012162ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:11.554149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8baca-688d-4eab-8f70-f55012162ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:11.554433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8baca-688d-4eab-8f70-f55012162ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:11.554711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8baca-688d-4eab-8f70-f55012162ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:11.555426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8baca-688d-4eab-8f70-f55012162ed2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:27:11.555735 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8baca-688d-4eab-8f70-f55012162ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:11.557134 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8baca-688d-4eab-8f70-f55012162ed2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:11.565657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 606/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:27:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:27:11.571421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb0a28-0a1b-4ed3-b2ad-caf09baa9220 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:11.590426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:11.669147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb0a28-0a1b-4ed3-b2ad-caf09baa9220 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:11.702948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca25275-274c-4a34-85b0-cda1e3fe77a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:11.703581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca25275-274c-4a34-85b0-cda1e3fe77a8 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:11.703974 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca25275-274c-4a34-85b0-cda1e3fe77a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:11.704254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca25275-274c-4a34-85b0-cda1e3fe77a8 None admin] PATH_INFO: `/v3/users/87b6c038784a44398d12e4c0bb147f34` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:11.705420 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca25275-274c-4a34-85b0-cda1e3fe77a8 None admin] RBAC: Authorizing `identity:get_user(user_id=87b6c038784a44398d12e4c0bb147f34)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:11.706831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca25275-274c-4a34-85b0-cda1e3fe77a8 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:11.708447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 591/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 25 21:27:11 2022] GET /identity/v3/users/87b6c038784a44398d12e4c0bb147f34 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:27:11.714095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8baca-688d-4eab-8f70-f55012162ed2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:11.759776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:11.814084 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8baca-688d-4eab-8f70-f55012162ed2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:11.846450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b577b-72f9-4bb9-9681-791fbf19901d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:11.847065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b577b-72f9-4bb9-9681-791fbf19901d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:11.847350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b577b-72f9-4bb9-9681-791fbf19901d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:11.847628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b577b-72f9-4bb9-9681-791fbf19901d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:11.912959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b577b-72f9-4bb9-9681-791fbf19901d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:11.914555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b577b-72f9-4bb9-9681-791fbf19901d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:11.957535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:12.011144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 607/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:27:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:27:12.016871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca25275-274c-4a34-85b0-cda1e3fe77a8 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:12.098428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:12.114025 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca25275-274c-4a34-85b0-cda1e3fe77a8 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:12.146961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13cbb1-eb1c-451c-8538-fe2e6b860997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:12.147598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13cbb1-eb1c-451c-8538-fe2e6b860997 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:12.147920 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13cbb1-eb1c-451c-8538-fe2e6b860997 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:12.148197 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13cbb1-eb1c-451c-8538-fe2e6b860997 None admin] PATH_INFO: `/v3/projects/3ad856aec76f4486895543fbb42d07e0` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:12.149351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13cbb1-eb1c-451c-8538-fe2e6b860997 None admin] RBAC: Authorizing `identity:get_project(project_id=3ad856aec76f4486895543fbb42d07e0)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:12.150768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13cbb1-eb1c-451c-8538-fe2e6b860997 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:12.152466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 592/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 25 21:27:12 2022] GET /identity/v3/projects/3ad856aec76f4486895543fbb42d07e0 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:27:12.159315 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b577b-72f9-4bb9-9681-791fbf19901d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:27:12.256983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b577b-72f9-4bb9-9681-791fbf19901d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:27:12.290744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c3054-3f86-4d90-80a4-69d3255d839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:27:12.291346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c3054-3f86-4d90-80a4-69d3255d839c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:27:12.291628 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c3054-3f86-4d90-80a4-69d3255d839c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:27:12.291937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c3054-3f86-4d90-80a4-69d3255d839c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:27:12.292720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c3054-3f86-4d90-80a4-69d3255d839c None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=3ad856aec76f4486895543fbb42d07e0, user.id=87b6c038784a44398d12e4c0bb147f34) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:27:12.293031 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c3054-3f86-4d90-80a4-69d3255d839c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:27:12.294451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c3054-3f86-4d90-80a4-69d3255d839c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:27:12.300765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 608/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:27:12 2022] GET /identity/v3/role_assignments?user.id=87b6c038784a44398d12e4c0bb147f34&scope.project.id=3ad856aec76f4486895543fbb42d07e0&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:27:22.142966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=24 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:27:22.298164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=96 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:24.438487 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42490a03-d436-4d9b-9978-893c47c8898d None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:24.439136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42490a03-d436-4d9b-9978-893c47c8898d None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:24.439136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42490a03-d436-4d9b-9978-893c47c8898d None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:24.441237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 593/1201] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:24.446603 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b25a3-a388-4d0c-a921-ff3980421579 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:24.450445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b25a3-a388-4d0c-a921-ff3980421579 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:24.450445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b25a3-a388-4d0c-a921-ff3980421579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:24.465232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-b16b25a3-a388-4d0c-a921-ff3980421579 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:24.466415 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b16b25a3-a388-4d0c-a921-ff3980421579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:24.533672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 609/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:28:24.558149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42490a03-d436-4d9b-9978-893c47c8898d None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:24.659761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42490a03-d436-4d9b-9978-893c47c8898d None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:24.695551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb361b-1595-4248-bed9-dc728ab7cf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:24.696224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb361b-1595-4248-bed9-dc728ab7cf1c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:24.696502 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb361b-1595-4248-bed9-dc728ab7cf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:24.696771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb361b-1595-4248-bed9-dc728ab7cf1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:24.707427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb361b-1595-4248-bed9-dc728ab7cf1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:24.708991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb361b-1595-4248-bed9-dc728ab7cf1c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-7feb361b-1595-4248-bed9-dc728ab7cf1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:28:24.723978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:24.725091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:24.726257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:28:24.726257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:28:24.726257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:24.726257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:24.726257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 594/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:24.731158 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b25a3-a388-4d0c-a921-ff3980421579 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:24.830123 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b25a3-a388-4d0c-a921-ff3980421579 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:24.858174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:24.864345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0aa1ab-50b5-4c75-ae19-8497948aed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:24.864963 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0aa1ab-50b5-4c75-ae19-8497948aed50 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:24.865246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0aa1ab-50b5-4c75-ae19-8497948aed50 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:24.869545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0aa1ab-50b5-4c75-ae19-8497948aed50 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:24.869545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0aa1ab-50b5-4c75-ae19-8497948aed50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:24.869545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0aa1ab-50b5-4c75-ae19-8497948aed50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:24.869545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0aa1ab-50b5-4c75-ae19-8497948aed50 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:24.879048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 610/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:24.884911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb361b-1595-4248-bed9-dc728ab7cf1c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:24.938328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:24.983937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb361b-1595-4248-bed9-dc728ab7cf1c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:25.017845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcba2b-9f8e-497b-96cd-b8521ab5aaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:25.018975 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcba2b-9f8e-497b-96cd-b8521ab5aaa4 None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:25.021099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcba2b-9f8e-497b-96cd-b8521ab5aaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:25.021099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcba2b-9f8e-497b-96cd-b8521ab5aaa4 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:25.021099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcba2b-9f8e-497b-96cd-b8521ab5aaa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:25.021611 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcba2b-9f8e-497b-96cd-b8521ab5aaa4 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:25.143202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 595/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 25 21:28:24 2022] POST /identity/v3/users => generated 251 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:28:27.175687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b4dc7-5b43-4d10-b8b6-dba3392bdac0 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:27.176276 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b4dc7-5b43-4d10-b8b6-dba3392bdac0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:27.176276 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b4dc7-5b43-4d10-b8b6-dba3392bdac0 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:27.177645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 611/1206] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:27.182801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0264-2f20-4e93-b2d5-8634e2fdb0b8 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:27.189654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0264-2f20-4e93-b2d5-8634e2fdb0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:27.189654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0264-2f20-4e93-b2d5-8634e2fdb0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:27.201955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-14ec0264-2f20-4e93-b2d5-8634e2fdb0b8 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:27.203145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-14ec0264-2f20-4e93-b2d5-8634e2fdb0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:27.269404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 596/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:28:27.292561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b4dc7-5b43-4d10-b8b6-dba3392bdac0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:27.394123 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b4dc7-5b43-4d10-b8b6-dba3392bdac0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:27.428688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aa1b1-a82d-4447-8798-6d3ae0f7c073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:27.429256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aa1b1-a82d-4447-8798-6d3ae0f7c073 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:27.429541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aa1b1-a82d-4447-8798-6d3ae0f7c073 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:27.429818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aa1b1-a82d-4447-8798-6d3ae0f7c073 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:27.439940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743aa1b1-a82d-4447-8798-6d3ae0f7c073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-743aa1b1-a82d-4447-8798-6d3ae0f7c073 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:28:27.445079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:27.446307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:27.447367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:27.447367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:27.447367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:27.447367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:27.447367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:28:27.447367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:28:27.447367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:28:27.447367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:28:27.447367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:28:27.447367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:28:27.447367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:28:27.447367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:27.447367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 612/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:28:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:27.452417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec0264-2f20-4e93-b2d5-8634e2fdb0b8 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:27.491897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:27.551647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec0264-2f20-4e93-b2d5-8634e2fdb0b8 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:27.586779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584bd6a-8afe-4f45-b18e-c98cd445f7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:27.587400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584bd6a-8afe-4f45-b18e-c98cd445f7ee None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:27.587685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584bd6a-8afe-4f45-b18e-c98cd445f7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:27.587995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584bd6a-8afe-4f45-b18e-c98cd445f7ee None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:27.588798 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584bd6a-8afe-4f45-b18e-c98cd445f7ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:27.589106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584bd6a-8afe-4f45-b18e-c98cd445f7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:27.590678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584bd6a-8afe-4f45-b18e-c98cd445f7ee None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:27.599501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 597/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:28:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:27.605308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aa1b1-a82d-4447-8798-6d3ae0f7c073 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:27.656242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:27.707891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aa1b1-a82d-4447-8798-6d3ae0f7c073 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:27.744856 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1b8ac-d91d-4620-b636-73a41dd6cef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:27.745501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b8ac-d91d-4620-b636-73a41dd6cef2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:27.745786 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b8ac-d91d-4620-b636-73a41dd6cef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:27.746063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1b8ac-d91d-4620-b636-73a41dd6cef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:27.756630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1b8ac-d91d-4620-b636-73a41dd6cef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:27.758075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1b8ac-d91d-4620-b636-73a41dd6cef2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ebe1b8ac-d91d-4620-b636-73a41dd6cef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:28:27.773530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:27.774644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:27.775949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:28:27.775949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:28:27.775949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:27.775949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:27.775949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 613/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:27.780641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584bd6a-8afe-4f45-b18e-c98cd445f7ee None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:27.874777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:27.877471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584bd6a-8afe-4f45-b18e-c98cd445f7ee None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:27.911544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbebb6-87d0-47e5-a386-309b94c4b0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:27.912188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbebb6-87d0-47e5-a386-309b94c4b0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:27.912469 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbebb6-87d0-47e5-a386-309b94c4b0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:27.912744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbebb6-87d0-47e5-a386-309b94c4b0f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:27.913428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbebb6-87d0-47e5-a386-309b94c4b0f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:27.913731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbebb6-87d0-47e5-a386-309b94c4b0f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:27.915081 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbebb6-87d0-47e5-a386-309b94c4b0f4 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:27.926490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 598/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:27.931990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1b8ac-d91d-4620-b636-73a41dd6cef2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:28.037839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1b8ac-d91d-4620-b636-73a41dd6cef2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:28.039472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:28.073326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c8e88-1c57-477b-bd80-807bd6408744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:28.073980 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c8e88-1c57-477b-bd80-807bd6408744 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:28.074309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c8e88-1c57-477b-bd80-807bd6408744 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:28.074651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c8e88-1c57-477b-bd80-807bd6408744 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:28.082477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c8e88-1c57-477b-bd80-807bd6408744 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:28.083987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c8e88-1c57-477b-bd80-807bd6408744 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-c17c8e88-1c57-477b-bd80-807bd6408744 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:28:28.097212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:28.098703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:28.099996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:28.099996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:28.099996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:28:28.099996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:28:28.099996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:28:28.099996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:28:28.099996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:28:28.099996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:28:28.099996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:28:28.099996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:28.099996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 614/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:28.104285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbebb6-87d0-47e5-a386-309b94c4b0f4 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:28.204535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbebb6-87d0-47e5-a386-309b94c4b0f4 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:28.238883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500747a-214a-4a90-bc9a-81252bf103c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:28.239489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500747a-214a-4a90-bc9a-81252bf103c9 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:28.239788 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500747a-214a-4a90-bc9a-81252bf103c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:28.240229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500747a-214a-4a90-bc9a-81252bf103c9 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:28.241012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500747a-214a-4a90-bc9a-81252bf103c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:28.241313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500747a-214a-4a90-bc9a-81252bf103c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:28.242722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500747a-214a-4a90-bc9a-81252bf103c9 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:28.259441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 599/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 25 21:28:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:28.265232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c8e88-1c57-477b-bd80-807bd6408744 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:28.367837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c8e88-1c57-477b-bd80-807bd6408744 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:28.401396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2bc55-7d9e-4926-9df3-214e0c1030ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:28.402014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2bc55-7d9e-4926-9df3-214e0c1030ca None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:28.402297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2bc55-7d9e-4926-9df3-214e0c1030ca None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:28.402571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2bc55-7d9e-4926-9df3-214e0c1030ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:28.433959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:28.472260 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2bc55-7d9e-4926-9df3-214e0c1030ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:28.473591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2bc55-7d9e-4926-9df3-214e0c1030ca None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:28.573390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 615/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:28:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:28:28.579354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500747a-214a-4a90-bc9a-81252bf103c9 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:28.598712 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:28.685354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500747a-214a-4a90-bc9a-81252bf103c9 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:28.718444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681d681-f968-4450-a991-13b698529bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:28.719082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681d681-f968-4450-a991-13b698529bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:28.719361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681d681-f968-4450-a991-13b698529bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:28.719632 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681d681-f968-4450-a991-13b698529bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:28.730059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681d681-f968-4450-a991-13b698529bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:28.731489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681d681-f968-4450-a991-13b698529bb1 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-e681d681-f968-4450-a991-13b698529bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:28:28.746464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:28.747526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:28.748696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:28:28.748696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:28:28.748696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:28.748696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:28.748696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 600/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:28.753651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2bc55-7d9e-4926-9df3-214e0c1030ca None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:28.813365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:28.851546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2bc55-7d9e-4926-9df3-214e0c1030ca None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:28.884761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeae952-b4a7-4974-b60c-ee57d3fcde9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:28.885529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeae952-b4a7-4974-b60c-ee57d3fcde9b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:28.885814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeae952-b4a7-4974-b60c-ee57d3fcde9b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:28.886098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeae952-b4a7-4974-b60c-ee57d3fcde9b None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:28.886795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeae952-b4a7-4974-b60c-ee57d3fcde9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:28.887104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeae952-b4a7-4974-b60c-ee57d3fcde9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:28.888538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeae952-b4a7-4974-b60c-ee57d3fcde9b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:28.900931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 616/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:28:28.906681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681d681-f968-4450-a991-13b698529bb1 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:28.975386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:29.005983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681d681-f968-4450-a991-13b698529bb1 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:29.039652 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25389c3-a8f9-49ac-b2b9-dea258491a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:29.040381 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25389c3-a8f9-49ac-b2b9-dea258491a40 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:29.040641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25389c3-a8f9-49ac-b2b9-dea258491a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:29.040917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25389c3-a8f9-49ac-b2b9-dea258491a40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:29.047318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25389c3-a8f9-49ac-b2b9-dea258491a40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:29.048782 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25389c3-a8f9-49ac-b2b9-dea258491a40 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-d25389c3-a8f9-49ac-b2b9-dea258491a40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:28:29.060915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:29.061988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:29.063078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:28:29.063078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:28:29.063078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:28:29.063078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:28:29.063078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:28:29.063078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:28:29.063078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:28:29.063078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:29.063078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 601/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:29.068347 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeae952-b4a7-4974-b60c-ee57d3fcde9b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:29.168174 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeae952-b4a7-4974-b60c-ee57d3fcde9b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:29.190846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:29.201898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783324db-e582-4f4b-8aed-c31eedddf299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:29.202565 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783324db-e582-4f4b-8aed-c31eedddf299 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:29.202846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783324db-e582-4f4b-8aed-c31eedddf299 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:29.203119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783324db-e582-4f4b-8aed-c31eedddf299 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:29.203893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783324db-e582-4f4b-8aed-c31eedddf299 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:29.204198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783324db-e582-4f4b-8aed-c31eedddf299 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:29.205625 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783324db-e582-4f4b-8aed-c31eedddf299 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:29.217921 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 617/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:29.224422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25389c3-a8f9-49ac-b2b9-dea258491a40 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:29.324666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25389c3-a8f9-49ac-b2b9-dea258491a40 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:29.352202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:29.357835 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dc1d2-0ce1-4200-8713-82df1db9c7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:29.358441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc1d2-0ce1-4200-8713-82df1db9c7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:29.358717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc1d2-0ce1-4200-8713-82df1db9c7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:29.358987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dc1d2-0ce1-4200-8713-82df1db9c7b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:29.359790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dc1d2-0ce1-4200-8713-82df1db9c7b0 None admin] RBAC: Adding query filter params (role.id=41a3de4f5213430bb14205f0f3aabadc, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=6076b9f003c749348fcddef6f6ed28e2) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:29.360099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dc1d2-0ce1-4200-8713-82df1db9c7b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:29.361500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dc1d2-0ce1-4200-8713-82df1db9c7b0 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:29.367255 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 602/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:28:29 2022] GET /identity/v3/role_assignments?user.id=6076b9f003c749348fcddef6f6ed28e2&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=41a3de4f5213430bb14205f0f3aabadc => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:31.385328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d21f4-1e33-49a1-89c7-48c5dffe0a92 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:31.385864 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d21f4-1e33-49a1-89c7-48c5dffe0a92 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:31.385864 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d21f4-1e33-49a1-89c7-48c5dffe0a92 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:31.387265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 618/1220] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:31.392554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2b3bc-45b1-47be-aa4a-6f2a15a5441b None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:31.392959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2b3bc-45b1-47be-aa4a-6f2a15a5441b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:31.393698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2b3bc-45b1-47be-aa4a-6f2a15a5441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:31.412444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-45a2b3bc-45b1-47be-aa4a-6f2a15a5441b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:31.413642 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-45a2b3bc-45b1-47be-aa4a-6f2a15a5441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:31.480733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 603/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:28:31.504474 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d21f4-1e33-49a1-89c7-48c5dffe0a92 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:31.609024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d21f4-1e33-49a1-89c7-48c5dffe0a92 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:31.642580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07577943-d12c-47ac-abc4-5c813a5260a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:31.643234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07577943-d12c-47ac-abc4-5c813a5260a5 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:31.643440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07577943-d12c-47ac-abc4-5c813a5260a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:31.643718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07577943-d12c-47ac-abc4-5c813a5260a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:31.654107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07577943-d12c-47ac-abc4-5c813a5260a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-07577943-d12c-47ac-abc4-5c813a5260a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:28:31.659627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:31.661831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:31.663470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:31.663470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:31.663470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:31.663470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:31.663470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:28:31.663470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:28:31.663470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:28:31.663470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:28:31.663470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:28:31.663470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:28:31.663470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:28:31.663470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:31.663470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 619/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:28:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:31.667393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2b3bc-45b1-47be-aa4a-6f2a15a5441b None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:31.766933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2b3bc-45b1-47be-aa4a-6f2a15a5441b None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:31.790318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:31.801866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95f854-6743-4a2f-9c0a-e632b70dbfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:31.802486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f854-6743-4a2f-9c0a-e632b70dbfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:31.802785 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f854-6743-4a2f-9c0a-e632b70dbfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:31.803040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95f854-6743-4a2f-9c0a-e632b70dbfe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:31.803764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95f854-6743-4a2f-9c0a-e632b70dbfe2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:31.804084 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95f854-6743-4a2f-9c0a-e632b70dbfe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:31.805437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95f854-6743-4a2f-9c0a-e632b70dbfe2 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:31.813559 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 604/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:28:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:31.820278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07577943-d12c-47ac-abc4-5c813a5260a5 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:31.864899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:31.921479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07577943-d12c-47ac-abc4-5c813a5260a5 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:31.954518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65d1e0-e793-4c0a-baa1-57e28bf63752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:31.955150 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65d1e0-e793-4c0a-baa1-57e28bf63752 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:31.956061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65d1e0-e793-4c0a-baa1-57e28bf63752 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:31.956736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65d1e0-e793-4c0a-baa1-57e28bf63752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:31.966900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65d1e0-e793-4c0a-baa1-57e28bf63752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:31.968998 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65d1e0-e793-4c0a-baa1-57e28bf63752 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-fa65d1e0-e793-4c0a-baa1-57e28bf63752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:28:31.983145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:31.984342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:31.985324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:28:31.985324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:28:31.985324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:31.985324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:31.985324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 620/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:31.990489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95f854-6743-4a2f-9c0a-e632b70dbfe2 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:32.090512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95f854-6743-4a2f-9c0a-e632b70dbfe2 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:32.123562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfca54d-69a4-4c40-bd75-46d322593273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:32.124195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca54d-69a4-4c40-bd75-46d322593273 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:32.124475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca54d-69a4-4c40-bd75-46d322593273 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:32.124740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca54d-69a4-4c40-bd75-46d322593273 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:32.125418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfca54d-69a4-4c40-bd75-46d322593273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:32.125719 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfca54d-69a4-4c40-bd75-46d322593273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:32.127059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfca54d-69a4-4c40-bd75-46d322593273 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:32.138853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 605/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:32.145222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65d1e0-e793-4c0a-baa1-57e28bf63752 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:32.240743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:32.247264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65d1e0-e793-4c0a-baa1-57e28bf63752 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:32.281870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39824d2-c802-495e-be1a-fdd228556f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:32.282506 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39824d2-c802-495e-be1a-fdd228556f8f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:32.282790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39824d2-c802-495e-be1a-fdd228556f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:32.283066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39824d2-c802-495e-be1a-fdd228556f8f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:32.290976 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39824d2-c802-495e-be1a-fdd228556f8f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:32.292453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39824d2-c802-495e-be1a-fdd228556f8f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-b39824d2-c802-495e-be1a-fdd228556f8f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:28:32.304466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:32.305634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:32.306801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:32.306801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:32.306801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:28:32.306801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:28:32.306801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:28:32.306801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:28:32.306801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:28:32.306801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:28:32.306801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:28:32.306801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:32.306801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 621/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:32.311650 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfca54d-69a4-4c40-bd75-46d322593273 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:32.359015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:32.411454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfca54d-69a4-4c40-bd75-46d322593273 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:32.447561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de535f-693c-4e45-8efa-45eec66754a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:32.448207 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de535f-693c-4e45-8efa-45eec66754a2 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:32.448492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de535f-693c-4e45-8efa-45eec66754a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:32.448775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de535f-693c-4e45-8efa-45eec66754a2 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:32.449603 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de535f-693c-4e45-8efa-45eec66754a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:32.449912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de535f-693c-4e45-8efa-45eec66754a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:32.451325 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de535f-693c-4e45-8efa-45eec66754a2 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:32.468927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 606/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 25 21:28:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:32.474754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39824d2-c802-495e-be1a-fdd228556f8f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:32.575870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39824d2-c802-495e-be1a-fdd228556f8f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:32.609126 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dfa02-c35a-4ad1-8a6d-6b54dfb33c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:32.609769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dfa02-c35a-4ad1-8a6d-6b54dfb33c95 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:32.610080 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dfa02-c35a-4ad1-8a6d-6b54dfb33c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:32.610352 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dfa02-c35a-4ad1-8a6d-6b54dfb33c95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:32.621372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dfa02-c35a-4ad1-8a6d-6b54dfb33c95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:32.622807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dfa02-c35a-4ad1-8a6d-6b54dfb33c95 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-0e4dfa02-c35a-4ad1-8a6d-6b54dfb33c95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:28:32.637082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:32.638130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:32.639179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:28:32.639179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:28:32.639179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:32.639179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:32.639179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 622/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:32.644070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de535f-693c-4e45-8efa-45eec66754a2 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:32.743602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de535f-693c-4e45-8efa-45eec66754a2 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:32.745891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:32.776878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac042f84-4e94-48cc-a4f9-a9f4052a4579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:32.777496 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac042f84-4e94-48cc-a4f9-a9f4052a4579 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:32.777777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac042f84-4e94-48cc-a4f9-a9f4052a4579 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:32.778051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac042f84-4e94-48cc-a4f9-a9f4052a4579 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:32.778736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac042f84-4e94-48cc-a4f9-a9f4052a4579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:32.779055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac042f84-4e94-48cc-a4f9-a9f4052a4579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:32.780430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac042f84-4e94-48cc-a4f9-a9f4052a4579 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:32.791793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 607/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:32.797620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dfa02-c35a-4ad1-8a6d-6b54dfb33c95 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:32.808631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:32.899290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dfa02-c35a-4ad1-8a6d-6b54dfb33c95 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:32.932725 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632fb92-3093-42e3-9734-1420a8b1ad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:32.933374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632fb92-3093-42e3-9734-1420a8b1ad69 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:32.933641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632fb92-3093-42e3-9734-1420a8b1ad69 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:32.933915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632fb92-3093-42e3-9734-1420a8b1ad69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:32.941124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632fb92-3093-42e3-9734-1420a8b1ad69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:32.942642 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632fb92-3093-42e3-9734-1420a8b1ad69 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-5632fb92-3093-42e3-9734-1420a8b1ad69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:28:32.953873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:32.955165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:32.956740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:28:32.956740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:28:32.956740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:28:32.956740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:28:32.956740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:28:32.956740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:28:32.956740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:28:32.956740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:32.956740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 623/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:32.961047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac042f84-4e94-48cc-a4f9-a9f4052a4579 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:33.071614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac042f84-4e94-48cc-a4f9-a9f4052a4579 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:33.104703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67d319-0f93-468c-9f1a-1349d7377e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:33.105317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67d319-0f93-468c-9f1a-1349d7377e54 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:33.105601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67d319-0f93-468c-9f1a-1349d7377e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:33.105876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67d319-0f93-468c-9f1a-1349d7377e54 None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:33.106621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67d319-0f93-468c-9f1a-1349d7377e54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:33.106928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67d319-0f93-468c-9f1a-1349d7377e54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:33.108388 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67d319-0f93-468c-9f1a-1349d7377e54 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:33.121316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 608/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:33.127397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632fb92-3093-42e3-9734-1420a8b1ad69 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:33.193883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:33.227979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632fb92-3093-42e3-9734-1420a8b1ad69 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:33.260800 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae19b0-1c40-4e0c-95a0-f18234b8f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:33.261505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae19b0-1c40-4e0c-95a0-f18234b8f525 None admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:33.261789 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae19b0-1c40-4e0c-95a0-f18234b8f525 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:33.262066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae19b0-1c40-4e0c-95a0-f18234b8f525 None admin] PATH_INFO: `/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/6076b9f003c749348fcddef6f6ed28e2/roles/41a3de4f5213430bb14205f0f3aabadc` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:33.276459 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae19b0-1c40-4e0c-95a0-f18234b8f525 None admin] RBAC: Authorizing `identity:create_grant(project_id=48d9c81feed744bb9e322910711a0d3b, user_id=6076b9f003c749348fcddef6f6ed28e2, role_id=41a3de4f5213430bb14205f0f3aabadc)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:33.277899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae19b0-1c40-4e0c-95a0-f18234b8f525 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:33.344578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 624/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:28:33 2022] PUT /identity/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/6076b9f003c749348fcddef6f6ed28e2/roles/41a3de4f5213430bb14205f0f3aabadc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:28:35.372392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323edc6-16c4-443c-8ad6-4db525685c49 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:35.372929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323edc6-16c4-443c-8ad6-4db525685c49 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:35.372929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323edc6-16c4-443c-8ad6-4db525685c49 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:35.374281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 609/1233] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:35.379541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a71fe3-a959-452e-abb5-5d76116ea57f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:35.379996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a71fe3-a959-452e-abb5-5d76116ea57f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:35.380146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a71fe3-a959-452e-abb5-5d76116ea57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:35.398010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-01a71fe3-a959-452e-abb5-5d76116ea57f None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:35.399309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-01a71fe3-a959-452e-abb5-5d76116ea57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:35.466357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 625/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:28:35.491433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323edc6-16c4-443c-8ad6-4db525685c49 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:35.517137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:35.595196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323edc6-16c4-443c-8ad6-4db525685c49 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:35.630124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327715b-85a1-48f9-b06d-b8ac224b6099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:35.630689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327715b-85a1-48f9-b06d-b8ac224b6099 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:35.630964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327715b-85a1-48f9-b06d-b8ac224b6099 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:35.631232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327715b-85a1-48f9-b06d-b8ac224b6099 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:35.641223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327715b-85a1-48f9-b06d-b8ac224b6099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-8327715b-85a1-48f9-b06d-b8ac224b6099 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:28:35.647017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:35.653912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:35.654996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:35.654996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:35.654996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:35.654996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:35.654996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:28:35.654996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:28:35.654996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:28:35.654996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:28:35.654996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:28:35.654996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:28:35.654996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 21:28:35.654996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:35.654996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 610/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 25 21:28:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:35.656008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a71fe3-a959-452e-abb5-5d76116ea57f None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:35.702571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:35.755201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a71fe3-a959-452e-abb5-5d76116ea57f None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:35.790194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f779998-f9b9-4330-9368-353ee7732992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:35.790812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779998-f9b9-4330-9368-353ee7732992 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:35.791093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779998-f9b9-4330-9368-353ee7732992 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:35.791368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779998-f9b9-4330-9368-353ee7732992 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:35.792117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f779998-f9b9-4330-9368-353ee7732992 None admin] RBAC: Adding query filter params (name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:35.792433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f779998-f9b9-4330-9368-353ee7732992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:35.793841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f779998-f9b9-4330-9368-353ee7732992 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:35.801598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 626/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 25 21:28:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:35.807587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327715b-85a1-48f9-b06d-b8ac224b6099 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:35.889376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:35.904774 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327715b-85a1-48f9-b06d-b8ac224b6099 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:35.937912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4334767-f8c7-4e8f-a4fa-0af3e993ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:35.938549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334767-f8c7-4e8f-a4fa-0af3e993ff86 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:35.938832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334767-f8c7-4e8f-a4fa-0af3e993ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:35.939109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334767-f8c7-4e8f-a4fa-0af3e993ff86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:35.949590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4334767-f8c7-4e8f-a4fa-0af3e993ff86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:35.951026 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4334767-f8c7-4e8f-a4fa-0af3e993ff86 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-d4334767-f8c7-4e8f-a4fa-0af3e993ff86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:28:35.966038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:35.967102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:35.968214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:28:35.968214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:28:35.968214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:35.968214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:35.968214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 611/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:35.973781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f779998-f9b9-4330-9368-353ee7732992 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:36.073664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f779998-f9b9-4330-9368-353ee7732992 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:36.082928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:36.107615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede83637-26a2-4dde-b493-b359d381b91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:36.108271 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede83637-26a2-4dde-b493-b359d381b91f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:36.108558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede83637-26a2-4dde-b493-b359d381b91f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:36.108838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede83637-26a2-4dde-b493-b359d381b91f None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:36.109565 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede83637-26a2-4dde-b493-b359d381b91f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:36.109872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede83637-26a2-4dde-b493-b359d381b91f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:36.111279 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede83637-26a2-4dde-b493-b359d381b91f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:36.124479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 627/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:36.130766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4334767-f8c7-4e8f-a4fa-0af3e993ff86 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:36.231102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4334767-f8c7-4e8f-a4fa-0af3e993ff86 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:36.265052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427d0c4-d091-435f-adea-3a98ae6945e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:36.265685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427d0c4-d091-435f-adea-3a98ae6945e2 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:36.265967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427d0c4-d091-435f-adea-3a98ae6945e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:36.266239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427d0c4-d091-435f-adea-3a98ae6945e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:36.269533 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:36.274442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427d0c4-d091-435f-adea-3a98ae6945e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:36.275894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427d0c4-d091-435f-adea-3a98ae6945e2 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-e427d0c4-d091-435f-adea-3a98ae6945e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:28:36.288377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:36.289584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:36.290752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:36.290752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:36.290752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:28:36.290752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:28:36.290752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:28:36.290752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:28:36.290752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:28:36.290752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:28:36.290752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:28:36.290752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:36.290752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 612/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:36.295431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede83637-26a2-4dde-b493-b359d381b91f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:36.394568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede83637-26a2-4dde-b493-b359d381b91f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:36.430646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6f107-72be-47f7-abbd-87a7df6feb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:36.431267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6f107-72be-47f7-abbd-87a7df6feb66 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:36.431551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6f107-72be-47f7-abbd-87a7df6feb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:36.431855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6f107-72be-47f7-abbd-87a7df6feb66 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:36.432706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6f107-72be-47f7-abbd-87a7df6feb66 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:36.433016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6f107-72be-47f7-abbd-87a7df6feb66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:36.434439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6f107-72be-47f7-abbd-87a7df6feb66 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:36.451733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 628/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 25 21:28:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:36.458070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427d0c4-d091-435f-adea-3a98ae6945e2 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:36.558410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427d0c4-d091-435f-adea-3a98ae6945e2 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:36.592225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0f87b-f7bd-4684-90ed-bc0c8dfc2e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:36.592839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0f87b-f7bd-4684-90ed-bc0c8dfc2e00 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:36.593123 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0f87b-f7bd-4684-90ed-bc0c8dfc2e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:36.593400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0f87b-f7bd-4684-90ed-bc0c8dfc2e00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:36.653976 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:36.660768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0f87b-f7bd-4684-90ed-bc0c8dfc2e00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:36.662212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0f87b-f7bd-4684-90ed-bc0c8dfc2e00 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:36.758120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 613/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:28:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:28:36.764285 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6f107-72be-47f7-abbd-87a7df6feb66 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:36.791816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:36.862808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6f107-72be-47f7-abbd-87a7df6feb66 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:36.894981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a626479-cb88-45dd-8d0c-2bba18abee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:36.895612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a626479-cb88-45dd-8d0c-2bba18abee13 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:36.895922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a626479-cb88-45dd-8d0c-2bba18abee13 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:36.896202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a626479-cb88-45dd-8d0c-2bba18abee13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:36.905799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a626479-cb88-45dd-8d0c-2bba18abee13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:36.907240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a626479-cb88-45dd-8d0c-2bba18abee13 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-5a626479-cb88-45dd-8d0c-2bba18abee13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:28:36.922676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:36.923997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:36.926228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:28:36.926228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:28:36.926228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:36.926228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:36.926228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 629/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:36.932887 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0f87b-f7bd-4684-90ed-bc0c8dfc2e00 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:37.025902 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:37.031483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0f87b-f7bd-4684-90ed-bc0c8dfc2e00 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:37.065908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30934c-5437-456c-adf3-6c6f57ceb2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:37.066524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30934c-5437-456c-adf3-6c6f57ceb2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:37.067021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30934c-5437-456c-adf3-6c6f57ceb2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:37.067354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30934c-5437-456c-adf3-6c6f57ceb2d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:37.068045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30934c-5437-456c-adf3-6c6f57ceb2d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:37.068353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30934c-5437-456c-adf3-6c6f57ceb2d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:37.069750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30934c-5437-456c-adf3-6c6f57ceb2d7 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:37.081301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 614/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:37.087061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a626479-cb88-45dd-8d0c-2bba18abee13 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:37.165337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:37.186230 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a626479-cb88-45dd-8d0c-2bba18abee13 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:37.219249 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c684161-da70-4ad9-bb45-52961a466ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:37.219922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c684161-da70-4ad9-bb45-52961a466ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:37.220203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c684161-da70-4ad9-bb45-52961a466ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:37.220480 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c684161-da70-4ad9-bb45-52961a466ac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:37.227602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c684161-da70-4ad9-bb45-52961a466ac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:37.229069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c684161-da70-4ad9-bb45-52961a466ac2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-9c684161-da70-4ad9-bb45-52961a466ac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:28:37.240243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:37.241240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:37.242171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:28:37.242171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:28:37.242171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:28:37.242171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:28:37.242171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:28:37.242171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:28:37.242171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:28:37.242171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:37.242702 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 630/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:37.247381 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30934c-5437-456c-adf3-6c6f57ceb2d7 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:37.348922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30934c-5437-456c-adf3-6c6f57ceb2d7 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:37.380898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0732e0-c783-4a35-b6cd-8e8e494cb73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:37.381759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0732e0-c783-4a35-b6cd-8e8e494cb73d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:37.382239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0732e0-c783-4a35-b6cd-8e8e494cb73d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:37.382239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0732e0-c783-4a35-b6cd-8e8e494cb73d None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:37.382832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0732e0-c783-4a35-b6cd-8e8e494cb73d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:37.383138 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0732e0-c783-4a35-b6cd-8e8e494cb73d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:37.384593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0732e0-c783-4a35-b6cd-8e8e494cb73d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:37.397003 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 615/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:37.403195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c684161-da70-4ad9-bb45-52961a466ac2 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:37.504673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c684161-da70-4ad9-bb45-52961a466ac2 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:37.539077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f455c3-0355-4a9c-b4d9-93807a18e3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:37.539720 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f455c3-0355-4a9c-b4d9-93807a18e3ba None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:37.540064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f455c3-0355-4a9c-b4d9-93807a18e3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:37.540324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f455c3-0355-4a9c-b4d9-93807a18e3ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:37.541121 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f455c3-0355-4a9c-b4d9-93807a18e3ba None admin] RBAC: Adding query filter params (role.id=41a3de4f5213430bb14205f0f3aabadc, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=6076b9f003c749348fcddef6f6ed28e2) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:37.541435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f455c3-0355-4a9c-b4d9-93807a18e3ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:37.542973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f455c3-0355-4a9c-b4d9-93807a18e3ba None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:37.548774 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 631/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:28:37 2022] GET /identity/v3/role_assignments?user.id=6076b9f003c749348fcddef6f6ed28e2&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=41a3de4f5213430bb14205f0f3aabadc => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:39.593302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cdbf2-75e4-40bb-8c32-2abd76882f3e None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:39.593855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cdbf2-75e4-40bb-8c32-2abd76882f3e None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:39.593855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cdbf2-75e4-40bb-8c32-2abd76882f3e None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:39.595326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 616/1247] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:39.600618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c486b2-414b-4657-929f-a998485d230c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:39.601007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c486b2-414b-4657-929f-a998485d230c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:39.601168 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c486b2-414b-4657-929f-a998485d230c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:39.607476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:39.620709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-78c486b2-414b-4657-929f-a998485d230c None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:39.621889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-78c486b2-414b-4657-929f-a998485d230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:39.688629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 632/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:28:39.712167 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cdbf2-75e4-40bb-8c32-2abd76882f3e None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:39.730567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:39.810190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cdbf2-75e4-40bb-8c32-2abd76882f3e None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:39.843962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2480c23-9367-4529-8b94-85b2b707d60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:39.844534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2480c23-9367-4529-8b94-85b2b707d60c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:39.844816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2480c23-9367-4529-8b94-85b2b707d60c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:39.845092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2480c23-9367-4529-8b94-85b2b707d60c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:39.854957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2480c23-9367-4529-8b94-85b2b707d60c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-b2480c23-9367-4529-8b94-85b2b707d60c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:28:39.859895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:39.861016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:39.861924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:39.861924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:39.861924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:39.861924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:39.861924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:28:39.861924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:28:39.861924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:28:39.861924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:28:39.861924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:28:39.861924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:28:39.861924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:28:39.861924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:39.861924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 617/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:28:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:39.867094 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c486b2-414b-4657-929f-a998485d230c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:39.965890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c486b2-414b-4657-929f-a998485d230c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:39.995297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:40.000103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996818a-9d44-4329-948c-ddf602757a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:40.002531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996818a-9d44-4329-948c-ddf602757a66 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:40.002531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996818a-9d44-4329-948c-ddf602757a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:40.002531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996818a-9d44-4329-948c-ddf602757a66 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:40.002531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996818a-9d44-4329-948c-ddf602757a66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:40.002934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996818a-9d44-4329-948c-ddf602757a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:40.004244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996818a-9d44-4329-948c-ddf602757a66 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:40.012068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 633/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:28:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:40.018490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2480c23-9367-4529-8b94-85b2b707d60c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:40.096082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:40.118637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2480c23-9367-4529-8b94-85b2b707d60c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:40.152794 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90754-47c5-44c1-a2fd-4ad9d118b83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:40.153505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90754-47c5-44c1-a2fd-4ad9d118b83c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:40.153789 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90754-47c5-44c1-a2fd-4ad9d118b83c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:40.154063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e90754-47c5-44c1-a2fd-4ad9d118b83c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:40.164460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e90754-47c5-44c1-a2fd-4ad9d118b83c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:40.165887 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e90754-47c5-44c1-a2fd-4ad9d118b83c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-24e90754-47c5-44c1-a2fd-4ad9d118b83c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:28:40.181670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:40.182761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:40.184093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:28:40.184093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:28:40.184093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:40.184093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:40.184093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 618/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:40.188610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996818a-9d44-4329-948c-ddf602757a66 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:40.289331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996818a-9d44-4329-948c-ddf602757a66 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:40.323830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1a5fb-9206-45be-9c7c-b88fc4e9b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:40.324444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1a5fb-9206-45be-9c7c-b88fc4e9b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:40.324728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1a5fb-9206-45be-9c7c-b88fc4e9b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:40.325002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1a5fb-9206-45be-9c7c-b88fc4e9b7f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:40.325736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1a5fb-9206-45be-9c7c-b88fc4e9b7f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:40.326035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1a5fb-9206-45be-9c7c-b88fc4e9b7f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:40.327397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1a5fb-9206-45be-9c7c-b88fc4e9b7f9 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:40.339310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 634/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:40.345009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90754-47c5-44c1-a2fd-4ad9d118b83c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:40.446576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e90754-47c5-44c1-a2fd-4ad9d118b83c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:40.472475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:40.479935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9da1f-435d-410c-b394-213647abead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:40.480564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9da1f-435d-410c-b394-213647abead4 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:40.480849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9da1f-435d-410c-b394-213647abead4 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:40.481122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9da1f-435d-410c-b394-213647abead4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:40.488921 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9da1f-435d-410c-b394-213647abead4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:40.490434 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9da1f-435d-410c-b394-213647abead4 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-76a9da1f-435d-410c-b394-213647abead4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:28:40.501401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:40.503139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:40.504391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:40.504391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:40.504391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:28:40.504391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:28:40.504391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:28:40.504391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:28:40.504391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:28:40.504391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:28:40.504391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:28:40.504391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:40.504391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 619/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:40.509600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1a5fb-9206-45be-9c7c-b88fc4e9b7f9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:40.567207 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:40.611315 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1a5fb-9206-45be-9c7c-b88fc4e9b7f9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:40.646173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78dd44-5d14-41be-8e61-c4f13aded2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:40.646791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78dd44-5d14-41be-8e61-c4f13aded2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:40.647073 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78dd44-5d14-41be-8e61-c4f13aded2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:40.647346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78dd44-5d14-41be-8e61-c4f13aded2e8 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:40.648175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78dd44-5d14-41be-8e61-c4f13aded2e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:40.648486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78dd44-5d14-41be-8e61-c4f13aded2e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:40.649994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78dd44-5d14-41be-8e61-c4f13aded2e8 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:40.668544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 635/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 25 21:28:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:40.675570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9da1f-435d-410c-b394-213647abead4 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:40.776124 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9da1f-435d-410c-b394-213647abead4 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:40.810038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b80f72-1b44-4ec8-9e03-129468e94193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:40.810658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b80f72-1b44-4ec8-9e03-129468e94193 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:40.810956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b80f72-1b44-4ec8-9e03-129468e94193 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:40.811214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b80f72-1b44-4ec8-9e03-129468e94193 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:40.865374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:40.877059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b80f72-1b44-4ec8-9e03-129468e94193 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:40.878562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b80f72-1b44-4ec8-9e03-129468e94193 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:40.974185 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 620/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:28:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:28:40.980161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78dd44-5d14-41be-8e61-c4f13aded2e8 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:41.082690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78dd44-5d14-41be-8e61-c4f13aded2e8 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:41.097365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:41.121416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac4e7f-7128-4f2e-9166-d49aeac65405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:41.122128 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac4e7f-7128-4f2e-9166-d49aeac65405 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:41.122399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac4e7f-7128-4f2e-9166-d49aeac65405 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:41.122674 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac4e7f-7128-4f2e-9166-d49aeac65405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:41.132778 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac4e7f-7128-4f2e-9166-d49aeac65405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:41.134229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac4e7f-7128-4f2e-9166-d49aeac65405 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-16ac4e7f-7128-4f2e-9166-d49aeac65405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:28:41.150803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:41.151852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:41.152756 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:28:41.152756 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:28:41.152756 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:41.152756 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:41.152756 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 636/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:41.158145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b80f72-1b44-4ec8-9e03-129468e94193 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:41.245534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:41.257746 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b80f72-1b44-4ec8-9e03-129468e94193 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:41.291042 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e8955-74d9-47c5-8409-02700d3148d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:41.291894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e8955-74d9-47c5-8409-02700d3148d6 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:41.292207 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e8955-74d9-47c5-8409-02700d3148d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:41.292644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e8955-74d9-47c5-8409-02700d3148d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:41.294648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e8955-74d9-47c5-8409-02700d3148d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:41.294648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e8955-74d9-47c5-8409-02700d3148d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:41.295405 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361e8955-74d9-47c5-8409-02700d3148d6 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:41.306777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 621/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:41.312577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac4e7f-7128-4f2e-9166-d49aeac65405 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:41.414062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac4e7f-7128-4f2e-9166-d49aeac65405 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:41.448761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69e9a7-33da-4488-8209-fa2f936ed62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:41.449404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69e9a7-33da-4488-8209-fa2f936ed62f None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:41.449690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69e9a7-33da-4488-8209-fa2f936ed62f None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:41.449966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69e9a7-33da-4488-8209-fa2f936ed62f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:41.456940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69e9a7-33da-4488-8209-fa2f936ed62f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:41.458421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69e9a7-33da-4488-8209-fa2f936ed62f None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-ed69e9a7-33da-4488-8209-fa2f936ed62f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:28:41.469753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:41.471428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:41.472425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:28:41.472425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:28:41.472425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:28:41.472425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:28:41.472425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:28:41.472425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:28:41.472425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:28:41.472425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:41.475897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 637/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:28:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:41.477297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e8955-74d9-47c5-8409-02700d3148d6 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:41.579877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e8955-74d9-47c5-8409-02700d3148d6 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:41.614757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a230b77-8db4-4563-bf6c-4d7c99812deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:41.615404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a230b77-8db4-4563-bf6c-4d7c99812deb None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:41.615677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a230b77-8db4-4563-bf6c-4d7c99812deb None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:41.615976 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a230b77-8db4-4563-bf6c-4d7c99812deb None admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:41.616718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a230b77-8db4-4563-bf6c-4d7c99812deb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:41.617020 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a230b77-8db4-4563-bf6c-4d7c99812deb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:41.618443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a230b77-8db4-4563-bf6c-4d7c99812deb None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:41.630685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 622/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:28:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:41.636942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69e9a7-33da-4488-8209-fa2f936ed62f None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:41.667342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:41.741587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69e9a7-33da-4488-8209-fa2f936ed62f None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:41.775989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ba7c0-df07-4b16-9ba2-3d007a204478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:41.776592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ba7c0-df07-4b16-9ba2-3d007a204478 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:41.776906 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ba7c0-df07-4b16-9ba2-3d007a204478 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:41.777217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ba7c0-df07-4b16-9ba2-3d007a204478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:41.778009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ba7c0-df07-4b16-9ba2-3d007a204478 None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=6076b9f003c749348fcddef6f6ed28e2) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:41.778320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ba7c0-df07-4b16-9ba2-3d007a204478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:41.779775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ba7c0-df07-4b16-9ba2-3d007a204478 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:41.786008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 638/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:28:41 2022] GET /identity/v3/role_assignments?user.id=6076b9f003c749348fcddef6f6ed28e2&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:28:43.793651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab9bf9-1948-44ec-b0e7-f9f5c03fd846 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:43.794201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab9bf9-1948-44ec-b0e7-f9f5c03fd846 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:43.794201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab9bf9-1948-44ec-b0e7-f9f5c03fd846 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:43.795570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 623/1261] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:28:43.801619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d75b37-66f0-4aa5-940f-254b24e52f09 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:43.802028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d75b37-66f0-4aa5-940f-254b24e52f09 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:43.803709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d75b37-66f0-4aa5-940f-254b24e52f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:43.820976 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-57d75b37-66f0-4aa5-940f-254b24e52f09 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:43.822237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-57d75b37-66f0-4aa5-940f-254b24e52f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:43.889260 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 639/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:28:43.912305 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab9bf9-1948-44ec-b0e7-f9f5c03fd846 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:43.923227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:44.013716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab9bf9-1948-44ec-b0e7-f9f5c03fd846 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:44.052284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4d7dd-ae94-4f9d-a123-f9874e1a3a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:44.052927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4d7dd-ae94-4f9d-a123-f9874e1a3a6b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:44.053217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4d7dd-ae94-4f9d-a123-f9874e1a3a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:44.053494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4d7dd-ae94-4f9d-a123-f9874e1a3a6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:44.063789 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4d7dd-ae94-4f9d-a123-f9874e1a3a6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-59a4d7dd-ae94-4f9d-a123-f9874e1a3a6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:28:44.069270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:44.073407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:44.074441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:44.074441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:44.074441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:44.074441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:44.074441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:28:44.074441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:28:44.074441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:28:44.074441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:28:44.074441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:28:44.074441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:28:44.074441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:28:44.074441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:44.074441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 624/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:44.076441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d75b37-66f0-4aa5-940f-254b24e52f09 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:44.094361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:44.174908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d75b37-66f0-4aa5-940f-254b24e52f09 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:44.208418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ca7f7-fa71-483e-bea2-30fe4cfe7596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:44.209033 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ca7f7-fa71-483e-bea2-30fe4cfe7596 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:44.209314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ca7f7-fa71-483e-bea2-30fe4cfe7596 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:44.209588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ca7f7-fa71-483e-bea2-30fe4cfe7596 None admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:44.210307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ca7f7-fa71-483e-bea2-30fe4cfe7596 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:44.210606 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ca7f7-fa71-483e-bea2-30fe4cfe7596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:44.212011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ca7f7-fa71-483e-bea2-30fe4cfe7596 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:44.219890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 640/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:28:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:44.226267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4d7dd-ae94-4f9d-a123-f9874e1a3a6b None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:44.293371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:44.326422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4d7dd-ae94-4f9d-a123-f9874e1a3a6b None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:44.360626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d96fa-b4bd-4a2b-b8e3-af4c6070c174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:44.361320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d96fa-b4bd-4a2b-b8e3-af4c6070c174 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:44.361623 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d96fa-b4bd-4a2b-b8e3-af4c6070c174 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:44.362542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d96fa-b4bd-4a2b-b8e3-af4c6070c174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:44.373077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d96fa-b4bd-4a2b-b8e3-af4c6070c174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:44.374500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d96fa-b4bd-4a2b-b8e3-af4c6070c174 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-d61d96fa-b4bd-4a2b-b8e3-af4c6070c174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:28:44.388682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:44.394537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:44.395633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:28:44.395633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:28:44.395633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:44.395633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:44.395633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 625/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:44.396002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ca7f7-fa71-483e-bea2-30fe4cfe7596 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:44.481751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:44.501140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ca7f7-fa71-483e-bea2-30fe4cfe7596 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:44.536310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ac7c4-50b5-4908-a20a-0c667fb9de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:44.536880 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ac7c4-50b5-4908-a20a-0c667fb9de3a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:44.537156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ac7c4-50b5-4908-a20a-0c667fb9de3a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:44.537423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ac7c4-50b5-4908-a20a-0c667fb9de3a None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:44.538109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ac7c4-50b5-4908-a20a-0c667fb9de3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:44.538411 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ac7c4-50b5-4908-a20a-0c667fb9de3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:44.539783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ac7c4-50b5-4908-a20a-0c667fb9de3a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:44.552234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 641/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:44.557957 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d96fa-b4bd-4a2b-b8e3-af4c6070c174 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:44.662119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d96fa-b4bd-4a2b-b8e3-af4c6070c174 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:44.681617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:44.696451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2210f-9f2d-4318-9bd4-21faff1f61a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:44.697091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2210f-9f2d-4318-9bd4-21faff1f61a0 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:44.697375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2210f-9f2d-4318-9bd4-21faff1f61a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:44.697638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2210f-9f2d-4318-9bd4-21faff1f61a0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:44.705193 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2210f-9f2d-4318-9bd4-21faff1f61a0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:44.707932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2210f-9f2d-4318-9bd4-21faff1f61a0 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-f0d2210f-9f2d-4318-9bd4-21faff1f61a0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:28:44.719039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:44.720180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:44.721845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:44.721845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:44.721845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:28:44.721845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:28:44.721845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:28:44.721845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:28:44.721845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:28:44.721845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:28:44.721845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:28:44.721845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:44.721845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 626/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:44.727361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ac7c4-50b5-4908-a20a-0c667fb9de3a None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:44.827959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ac7c4-50b5-4908-a20a-0c667fb9de3a None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:44.863253 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf079b8-d41e-45bd-84a7-7be8ccf93da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:44.863892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf079b8-d41e-45bd-84a7-7be8ccf93da3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:44.864172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf079b8-d41e-45bd-84a7-7be8ccf93da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:44.864441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf079b8-d41e-45bd-84a7-7be8ccf93da3 None admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:44.865228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf079b8-d41e-45bd-84a7-7be8ccf93da3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:44.865536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf079b8-d41e-45bd-84a7-7be8ccf93da3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:44.866955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf079b8-d41e-45bd-84a7-7be8ccf93da3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:44.875432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:44.884198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 642/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 25 21:28:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:44.890131 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2210f-9f2d-4318-9bd4-21faff1f61a0 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:44.994297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2210f-9f2d-4318-9bd4-21faff1f61a0 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:45.028305 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a4501-2636-43bb-bde5-267052af3b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:45.028937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a4501-2636-43bb-bde5-267052af3b8f None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:45.029216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a4501-2636-43bb-bde5-267052af3b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:45.029488 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a4501-2636-43bb-bde5-267052af3b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:45.039945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a4501-2636-43bb-bde5-267052af3b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:45.041376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a4501-2636-43bb-bde5-267052af3b8f None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-558a4501-2636-43bb-bde5-267052af3b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:28:45.055437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:45.056573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:45.057682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:28:45.057682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:28:45.057682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:45.057682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:45.057682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 627/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:45.062354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf079b8-d41e-45bd-84a7-7be8ccf93da3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:45.162983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf079b8-d41e-45bd-84a7-7be8ccf93da3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:45.197178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cce5f-2ece-4df5-8a63-2d07bf8aee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:45.197833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cce5f-2ece-4df5-8a63-2d07bf8aee85 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:45.198091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cce5f-2ece-4df5-8a63-2d07bf8aee85 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:45.198362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cce5f-2ece-4df5-8a63-2d07bf8aee85 None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:45.199061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cce5f-2ece-4df5-8a63-2d07bf8aee85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:45.199365 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cce5f-2ece-4df5-8a63-2d07bf8aee85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:45.200819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cce5f-2ece-4df5-8a63-2d07bf8aee85 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:45.213087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 643/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:45.218981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a4501-2636-43bb-bde5-267052af3b8f None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:45.254559 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:45.324272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a4501-2636-43bb-bde5-267052af3b8f None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:45.356875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead9fe2-d2f4-4d7a-80b9-905ecc9df5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:45.357515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead9fe2-d2f4-4d7a-80b9-905ecc9df5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:45.357798 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead9fe2-d2f4-4d7a-80b9-905ecc9df5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:45.358072 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead9fe2-d2f4-4d7a-80b9-905ecc9df5c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:45.365537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead9fe2-d2f4-4d7a-80b9-905ecc9df5c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:45.366964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead9fe2-d2f4-4d7a-80b9-905ecc9df5c9 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-fead9fe2-d2f4-4d7a-80b9-905ecc9df5c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:28:45.378528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:45.380341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:45.382336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:28:45.382336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:28:45.382336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:28:45.382336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:28:45.382336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:28:45.382336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:28:45.382336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:28:45.382336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:45.382336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 628/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:45.385689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cce5f-2ece-4df5-8a63-2d07bf8aee85 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:45.445734 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:45.487187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cce5f-2ece-4df5-8a63-2d07bf8aee85 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:45.520633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d950a-44ea-45ec-b62a-579d8305a8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:45.521245 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d950a-44ea-45ec-b62a-579d8305a8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:45.521526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d950a-44ea-45ec-b62a-579d8305a8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:45.521799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d950a-44ea-45ec-b62a-579d8305a8a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:45.522548 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d950a-44ea-45ec-b62a-579d8305a8a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:45.522858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d950a-44ea-45ec-b62a-579d8305a8a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:45.524308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d950a-44ea-45ec-b62a-579d8305a8a6 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:45.536208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 644/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:45.542369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead9fe2-d2f4-4d7a-80b9-905ecc9df5c9 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:45.634815 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:45.644709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead9fe2-d2f4-4d7a-80b9-905ecc9df5c9 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:45.679423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4857d72-c33b-445a-b65d-43d33b2df0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:45.680202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4857d72-c33b-445a-b65d-43d33b2df0ca None admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:45.680641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4857d72-c33b-445a-b65d-43d33b2df0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:45.680923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4857d72-c33b-445a-b65d-43d33b2df0ca None admin] PATH_INFO: `/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/6076b9f003c749348fcddef6f6ed28e2/roles/11da9ce3f79148679dbde9eb2c568e55` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:45.682856 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4857d72-c33b-445a-b65d-43d33b2df0ca None admin] RBAC: Authorizing `identity:create_grant(project_id=48d9c81feed744bb9e322910711a0d3b, user_id=6076b9f003c749348fcddef6f6ed28e2, role_id=11da9ce3f79148679dbde9eb2c568e55)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:45.684317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4857d72-c33b-445a-b65d-43d33b2df0ca None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:45.808335 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 629/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 25 21:28:45 2022] PUT /identity/v3/projects/48d9c81feed744bb9e322910711a0d3b/users/6076b9f003c749348fcddef6f6ed28e2/roles/11da9ce3f79148679dbde9eb2c568e55 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:28:47.770328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c2dbf-03b0-4d09-8647-f8c5c427c9e4 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:47.770865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c2dbf-03b0-4d09-8647-f8c5c427c9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:47.770865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c2dbf-03b0-4d09-8647-f8c5c427c9e4 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:47.772308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 645/1274] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:47.777489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40b598-1097-48f8-9c1b-dd6d37d2b61e None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:47.777882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40b598-1097-48f8-9c1b-dd6d37d2b61e None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:47.778041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40b598-1097-48f8-9c1b-dd6d37d2b61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:47.797037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-ef40b598-1097-48f8-9c1b-dd6d37d2b61e None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:47.798261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-ef40b598-1097-48f8-9c1b-dd6d37d2b61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:47.864837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 630/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:28:47.889157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c2dbf-03b0-4d09-8647-f8c5c427c9e4 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:47.992471 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c2dbf-03b0-4d09-8647-f8c5c427c9e4 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:48.010723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:48.027640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63d764-a7ce-4746-8e35-57d831789cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:48.028314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d764-a7ce-4746-8e35-57d831789cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:48.028601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d764-a7ce-4746-8e35-57d831789cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:48.028951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d764-a7ce-4746-8e35-57d831789cc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:48.039082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63d764-a7ce-4746-8e35-57d831789cc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-0a63d764-a7ce-4746-8e35-57d831789cc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 21:28:48.044055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:48.045227 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:48.046200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:48.046200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:48.046200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:48.046200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:48.046200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 21:28:48.046200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 21:28:48.046200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 21:28:48.046200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 21:28:48.046200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 21:28:48.046200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 21:28:48.046200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 21:28:48.046200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:48.046200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 646/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 25 21:28:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:48.051587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40b598-1097-48f8-9c1b-dd6d37d2b61e None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:48.134944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:48.153025 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40b598-1097-48f8-9c1b-dd6d37d2b61e None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:48.186016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc05437-ea67-4677-aa7d-306ff21c8b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:48.186640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc05437-ea67-4677-aa7d-306ff21c8b6c None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:48.186923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc05437-ea67-4677-aa7d-306ff21c8b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:48.187196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc05437-ea67-4677-aa7d-306ff21c8b6c None admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:48.187942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc05437-ea67-4677-aa7d-306ff21c8b6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:48.188288 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc05437-ea67-4677-aa7d-306ff21c8b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:48.190269 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc05437-ea67-4677-aa7d-306ff21c8b6c None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:48.198374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 631/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 25 21:28:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:28:48.204100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63d764-a7ce-4746-8e35-57d831789cc9 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:48.306866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63d764-a7ce-4746-8e35-57d831789cc9 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:48.341221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c98467-19c0-4f63-9214-54290bde524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:48.341860 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c98467-19c0-4f63-9214-54290bde524c None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:48.342142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c98467-19c0-4f63-9214-54290bde524c None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:48.342415 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c98467-19c0-4f63-9214-54290bde524c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:48.352585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c98467-19c0-4f63-9214-54290bde524c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:48.354027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c98467-19c0-4f63-9214-54290bde524c None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-87c98467-19c0-4f63-9214-54290bde524c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:28:48.368995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:48.370119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:48.371106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:28:48.371106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:28:48.371106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:48.371106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:48.371106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 647/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:48.376265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc05437-ea67-4677-aa7d-306ff21c8b6c None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:48.475243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc05437-ea67-4677-aa7d-306ff21c8b6c None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:48.509241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b384f3-985a-4f69-8c50-40bf8af0c489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:48.509856 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b384f3-985a-4f69-8c50-40bf8af0c489 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:48.510158 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b384f3-985a-4f69-8c50-40bf8af0c489 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:48.510410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b384f3-985a-4f69-8c50-40bf8af0c489 None admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:48.511099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b384f3-985a-4f69-8c50-40bf8af0c489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:48.511393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b384f3-985a-4f69-8c50-40bf8af0c489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:48.512767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b384f3-985a-4f69-8c50-40bf8af0c489 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:48.524563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 632/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:48.530341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c98467-19c0-4f63-9214-54290bde524c None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:48.561524 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:48.632417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c98467-19c0-4f63-9214-54290bde524c None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:48.666293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbeae9-6252-4ab5-9f32-7dd66a12e632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:48.666923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbeae9-6252-4ab5-9f32-7dd66a12e632 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:48.667203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbeae9-6252-4ab5-9f32-7dd66a12e632 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:48.667470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbeae9-6252-4ab5-9f32-7dd66a12e632 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:48.675630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbeae9-6252-4ab5-9f32-7dd66a12e632 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:48.678389 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbeae9-6252-4ab5-9f32-7dd66a12e632 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-93cbeae9-6252-4ab5-9f32-7dd66a12e632 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 21:28:48.690619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:48.691581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:48.692599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:48.692599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:48.692599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 21:28:48.692599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 21:28:48.692599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 21:28:48.692599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 21:28:48.692599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 21:28:48.692599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 21:28:48.692599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 21:28:48.692599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:48.692599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 648/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:48.697826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b384f3-985a-4f69-8c50-40bf8af0c489 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:48.701620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:48.796722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b384f3-985a-4f69-8c50-40bf8af0c489 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:48.830013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e562e10-0f99-4c94-a2d9-aa12af035049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:48.830661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e562e10-0f99-4c94-a2d9-aa12af035049 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:48.830947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e562e10-0f99-4c94-a2d9-aa12af035049 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:48.831224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e562e10-0f99-4c94-a2d9-aa12af035049 None admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:48.832051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e562e10-0f99-4c94-a2d9-aa12af035049 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:48.832363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e562e10-0f99-4c94-a2d9-aa12af035049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:48.833822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e562e10-0f99-4c94-a2d9-aa12af035049 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:48.851073 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 633/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 25 21:28:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:48.856908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbeae9-6252-4ab5-9f32-7dd66a12e632 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:48.948682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:48.958253 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbeae9-6252-4ab5-9f32-7dd66a12e632 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:48.992302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febb064-0b40-401a-ab31-acc506750609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:48.992909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb064-0b40-401a-ab31-acc506750609 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:48.993188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb064-0b40-401a-ab31-acc506750609 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:48.993462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb064-0b40-401a-ab31-acc506750609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:49.062049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febb064-0b40-401a-ab31-acc506750609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:49.063541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febb064-0b40-401a-ab31-acc506750609 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:49.151410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:49.162338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 649/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 25 21:28:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 21:28:49.168219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e562e10-0f99-4c94-a2d9-aa12af035049 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:49.229447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:49.266591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e562e10-0f99-4c94-a2d9-aa12af035049 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:49.299734 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51f99b-9881-4f31-8e54-6ac6aac0cf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:49.300406 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51f99b-9881-4f31-8e54-6ac6aac0cf65 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:49.300739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51f99b-9881-4f31-8e54-6ac6aac0cf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:49.301249 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51f99b-9881-4f31-8e54-6ac6aac0cf65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:49.312059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51f99b-9881-4f31-8e54-6ac6aac0cf65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:49.313505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51f99b-9881-4f31-8e54-6ac6aac0cf65 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-bc51f99b-9881-4f31-8e54-6ac6aac0cf65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 21:28:49.327462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:49.328521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:49.329671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 21:28:49.329671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 21:28:49.329671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 21:28:49.329671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:49.329671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 634/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:49.334865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febb064-0b40-401a-ab31-acc506750609 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:49.432753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febb064-0b40-401a-ab31-acc506750609 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:49.468243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe40398-e716-4184-8dae-0f2f05d9684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:49.468857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe40398-e716-4184-8dae-0f2f05d9684d None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:49.469142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe40398-e716-4184-8dae-0f2f05d9684d None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:49.469420 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe40398-e716-4184-8dae-0f2f05d9684d None admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:49.470616 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe40398-e716-4184-8dae-0f2f05d9684d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:49.470616 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe40398-e716-4184-8dae-0f2f05d9684d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:49.471854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe40398-e716-4184-8dae-0f2f05d9684d None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:49.482865 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 650/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 25 21:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:49.488853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51f99b-9881-4f31-8e54-6ac6aac0cf65 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:49.593487 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51f99b-9881-4f31-8e54-6ac6aac0cf65 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:49.606812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:49.626055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49008b39-2c27-4da9-b523-c22d72f998f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:49.626697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49008b39-2c27-4da9-b523-c22d72f998f8 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:49.627507 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49008b39-2c27-4da9-b523-c22d72f998f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:49.627861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49008b39-2c27-4da9-b523-c22d72f998f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:49.634458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49008b39-2c27-4da9-b523-c22d72f998f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:49.636027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49008b39-2c27-4da9-b523-c22d72f998f8 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application [None req-49008b39-2c27-4da9-b523-c22d72f998f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 21:28:49.648122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:49.649231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:49.650345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 21:28:49.650345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 21:28:49.650345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 21:28:49.650345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 21:28:49.650345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 21:28:49.650345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 21:28:49.650345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 21:28:49.650345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: ERROR keystone.server.flask.application Jul 25 21:28:49.650345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 635/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 25 21:28:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:49.655275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe40398-e716-4184-8dae-0f2f05d9684d None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:49.711704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:49.760752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe40398-e716-4184-8dae-0f2f05d9684d None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:49.796169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcbe78-1ab9-4d05-93cb-c887d77f49c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:49.796812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcbe78-1ab9-4d05-93cb-c887d77f49c4 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:49.797097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcbe78-1ab9-4d05-93cb-c887d77f49c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:49.797392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcbe78-1ab9-4d05-93cb-c887d77f49c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:49.798246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcbe78-1ab9-4d05-93cb-c887d77f49c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:49.798518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcbe78-1ab9-4d05-93cb-c887d77f49c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:49.800730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcbe78-1ab9-4d05-93cb-c887d77f49c4 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:49.814229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 651/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 25 21:28:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:49.821724 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49008b39-2c27-4da9-b523-c22d72f998f8 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:49.931155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49008b39-2c27-4da9-b523-c22d72f998f8 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:49.966529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9ad9c-fc44-4bc2-a3f4-8cf55228374b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:49.967077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ad9c-fc44-4bc2-a3f4-8cf55228374b None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:49.967361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ad9c-fc44-4bc2-a3f4-8cf55228374b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:49.967638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9ad9c-fc44-4bc2-a3f4-8cf55228374b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:49.968488 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9ad9c-fc44-4bc2-a3f4-8cf55228374b None admin] RBAC: Adding query filter params (role.id=11da9ce3f79148679dbde9eb2c568e55, scope.project.id=48d9c81feed744bb9e322910711a0d3b, user.id=6076b9f003c749348fcddef6f6ed28e2) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:49.968836 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9ad9c-fc44-4bc2-a3f4-8cf55228374b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:49.970413 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9ad9c-fc44-4bc2-a3f4-8cf55228374b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:49.977409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 636/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 25 21:28:49 2022] GET /identity/v3/role_assignments?user.id=6076b9f003c749348fcddef6f6ed28e2&scope.project.id=48d9c81feed744bb9e322910711a0d3b&role.id=11da9ce3f79148679dbde9eb2c568e55 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:52.036980 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d5ad0-1056-450c-8342-0db3b100d909 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:52.037561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d5ad0-1056-450c-8342-0db3b100d909 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:52.037561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d5ad0-1056-450c-8342-0db3b100d909 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:52.038969 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 652/1288] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:52.044157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e985f-d660-4f0a-86c8-653c173e9560 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:52.047234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e985f-d660-4f0a-86c8-653c173e9560 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:52.047234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e985f-d660-4f0a-86c8-653c173e9560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:52.063463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-664e985f-d660-4f0a-86c8-653c173e9560 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:52.065127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-664e985f-d660-4f0a-86c8-653c173e9560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:52.094442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:52.131231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 637/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:28:52.154305 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d5ad0-1056-450c-8342-0db3b100d909 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:52.256597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d5ad0-1056-450c-8342-0db3b100d909 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:52.266828 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:52.291099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7b442-986a-419e-9387-0f3679b71a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:52.291701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7b442-986a-419e-9387-0f3679b71a90 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:52.292012 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7b442-986a-419e-9387-0f3679b71a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:52.292292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7b442-986a-419e-9387-0f3679b71a90 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:52.292907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7b442-986a-419e-9387-0f3679b71a90 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:52.294257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7b442-986a-419e-9387-0f3679b71a90 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-43e7b442-986a-419e-9387-0f3679b71a90 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:52.303339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:52.304587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:52.305812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 653/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 21:28:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:28:52.310534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e985f-d660-4f0a-86c8-653c173e9560 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:52.407933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e985f-d660-4f0a-86c8-653c173e9560 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:52.442275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c1aef-9b58-4c3f-9425-bc13fe26d03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:52.442884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c1aef-9b58-4c3f-9425-bc13fe26d03d None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:52.443166 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c1aef-9b58-4c3f-9425-bc13fe26d03d None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:52.443443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c1aef-9b58-4c3f-9425-bc13fe26d03d None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:52.444144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c1aef-9b58-4c3f-9425-bc13fe26d03d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:52.444449 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c1aef-9b58-4c3f-9425-bc13fe26d03d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:52.445870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c1aef-9b58-4c3f-9425-bc13fe26d03d None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:52.450598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 638/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Jul 25 21:28:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:52.457282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7b442-986a-419e-9387-0f3679b71a90 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:52.557177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7b442-986a-419e-9387-0f3679b71a90 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:52.591047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b9b29-470b-4c9a-a467-6075881c722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:52.591661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b9b29-470b-4c9a-a467-6075881c722a None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:52.591970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b9b29-470b-4c9a-a467-6075881c722a None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:52.592242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b9b29-470b-4c9a-a467-6075881c722a None admin] PATH_INFO: `/v3/services` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:52.592915 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b9b29-470b-4c9a-a467-6075881c722a None admin] RBAC: Adding query filter params (type=placement) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:52.593218 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b9b29-470b-4c9a-a467-6075881c722a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:52.594583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b9b29-470b-4c9a-a467-6075881c722a None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:52.601142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 654/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Jul 25 21:28:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:28:54.680296 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d1ec4-1e1f-4ffd-8e01-c72c204e5579 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:54.680845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d1ec4-1e1f-4ffd-8e01-c72c204e5579 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:54.680845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d1ec4-1e1f-4ffd-8e01-c72c204e5579 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:54.682200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 639/1293] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:54.687487 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ed747-b3b4-4edd-a3fe-c3569695979a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:54.687945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ed747-b3b4-4edd-a3fe-c3569695979a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:54.688088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ed747-b3b4-4edd-a3fe-c3569695979a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:54.708155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-1e1ed747-b3b4-4edd-a3fe-c3569695979a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:54.709355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1e1ed747-b3b4-4edd-a3fe-c3569695979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:54.738420 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:54.776080 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 655/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:28:54.799357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d1ec4-1e1f-4ffd-8e01-c72c204e5579 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:54.831257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:54.901187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d1ec4-1e1f-4ffd-8e01-c72c204e5579 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:54.934503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124baf69-1efc-4f9f-b0ac-07c060fe846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:54.935053 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124baf69-1efc-4f9f-b0ac-07c060fe846b None admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:54.935345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124baf69-1efc-4f9f-b0ac-07c060fe846b None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:54.935622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124baf69-1efc-4f9f-b0ac-07c060fe846b None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:54.936435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124baf69-1efc-4f9f-b0ac-07c060fe846b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:54.937797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124baf69-1efc-4f9f-b0ac-07c060fe846b None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:55.007262 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 640/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 25 21:28:54 2022] POST /identity/v3/services => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:28:57.018585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f9504-ca4e-435c-8ef5-dbd417ded700 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:57.019127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f9504-ca4e-435c-8ef5-dbd417ded700 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:57.019127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f9504-ca4e-435c-8ef5-dbd417ded700 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:57.020543 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 656/1296] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:57.025833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9eefd-d3ec-4af9-966a-2e6c3e91d53b None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:57.026256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9eefd-d3ec-4af9-966a-2e6c3e91d53b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:57.026393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9eefd-d3ec-4af9-966a-2e6c3e91d53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:57.044963 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-68b9eefd-d3ec-4af9-966a-2e6c3e91d53b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:57.050110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-68b9eefd-d3ec-4af9-966a-2e6c3e91d53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:57.117973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 641/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:57 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:28:57.140851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f9504-ca4e-435c-8ef5-dbd417ded700 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:57.244182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f9504-ca4e-435c-8ef5-dbd417ded700 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:57.277897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e5680-4fbe-4749-8c7d-2826dcc0a99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:57.278462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e5680-4fbe-4749-8c7d-2826dcc0a99b None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:57.278749 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e5680-4fbe-4749-8c7d-2826dcc0a99b None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:57.279024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e5680-4fbe-4749-8c7d-2826dcc0a99b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:57.279662 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e5680-4fbe-4749-8c7d-2826dcc0a99b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:57.281063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e5680-4fbe-4749-8c7d-2826dcc0a99b None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-981e5680-4fbe-4749-8c7d-2826dcc0a99b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:28:57.291022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:28:57.292301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:28:57.293522 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 657/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 21:28:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 21:28:57.298620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9eefd-d3ec-4af9-966a-2e6c3e91d53b None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:57.318017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:57.397292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9eefd-d3ec-4af9-966a-2e6c3e91d53b None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:57.430851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94b19b-89d4-443d-947b-964c428ef634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:57.431458 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b19b-89d4-443d-947b-964c428ef634 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:57.431784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b19b-89d4-443d-947b-964c428ef634 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:57.432190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94b19b-89d4-443d-947b-964c428ef634 None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:57.432853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94b19b-89d4-443d-947b-964c428ef634 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:57.433154 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94b19b-89d4-443d-947b-964c428ef634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:57.434497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94b19b-89d4-443d-947b-964c428ef634 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:57.439497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 642/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Jul 25 21:28:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:57.445791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e5680-4fbe-4749-8c7d-2826dcc0a99b None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:57.478991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:57.547872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e5680-4fbe-4749-8c7d-2826dcc0a99b None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:57.582251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e054a4d-8d24-46ad-8a79-379b1a106fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:57.582866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e054a4d-8d24-46ad-8a79-379b1a106fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:57.583194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e054a4d-8d24-46ad-8a79-379b1a106fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:57.583466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e054a4d-8d24-46ad-8a79-379b1a106fc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:57.584254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e054a4d-8d24-46ad-8a79-379b1a106fc2 None admin] RBAC: Adding query filter params (interface=public, service_id=4c9876519120480cbb7c6682560f0890, region_id=RegionOne) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:28:57.584564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e054a4d-8d24-46ad-8a79-379b1a106fc2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:57.585919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e054a4d-8d24-46ad-8a79-379b1a106fc2 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:57.590919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 658/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 25 21:28:57 2022] GET /identity/v3/endpoints?service_id=4c9876519120480cbb7c6682560f0890&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:28:57.597261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94b19b-89d4-443d-947b-964c428ef634 None admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:57.678356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:57.696716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94b19b-89d4-443d-947b-964c428ef634 None admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:28:57.731361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e7e83-9ebb-4c71-9bbd-f5440ec34daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:28:57.732013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e7e83-9ebb-4c71-9bbd-f5440ec34daf None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:57.732299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e7e83-9ebb-4c71-9bbd-f5440ec34daf None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:57.732576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e7e83-9ebb-4c71-9bbd-f5440ec34daf None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:57.733236 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e7e83-9ebb-4c71-9bbd-f5440ec34daf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:28:57.734653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e7e83-9ebb-4c71-9bbd-f5440ec34daf None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:28:57.741711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 643/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 25 21:28:57 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:28:59.774797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6d839-32e6-46e8-a30a-429a907fbda2 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:59.775329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6d839-32e6-46e8-a30a-429a907fbda2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:59.775417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6d839-32e6-46e8-a30a-429a907fbda2 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:59.776902 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 659/1302] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:28:59.782015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c851d-13b5-4d9f-bac2-55290b963d4c None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:28:59.782416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c851d-13b5-4d9f-bac2-55290b963d4c None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:28:59.782575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c851d-13b5-4d9f-bac2-55290b963d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:28:59.801674 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-aa9c851d-13b5-4d9f-bac2-55290b963d4c None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:28:59.802872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-aa9c851d-13b5-4d9f-bac2-55290b963d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:28:59.869489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 644/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:28:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 21:28:59.893293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6d839-32e6-46e8-a30a-429a907fbda2 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:28:59.989353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:28:59.996018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6d839-32e6-46e8-a30a-429a907fbda2 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:29:00.029923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a642bbd-b70e-4ec5-b92a-b9c1eec1b4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:29:00.030556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a642bbd-b70e-4ec5-b92a-b9c1eec1b4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:29:00.030838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a642bbd-b70e-4ec5-b92a-b9c1eec1b4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:29:00.031116 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a642bbd-b70e-4ec5-b92a-b9c1eec1b4f3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:29:00.031771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a642bbd-b70e-4ec5-b92a-b9c1eec1b4f3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:29:00.033144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a642bbd-b70e-4ec5-b92a-b9c1eec1b4f3 None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application [None req-8a642bbd-b70e-4ec5-b92a-b9c1eec1b4f3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 21:29:00.043159 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 21:29:00.049827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application with Lock( Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self._enter() Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application return self.creator() Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application created_value = creator( Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: ERROR keystone.server.flask.application Jul 25 21:29:00.050755 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 660/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 25 21:28:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 21:29:00.051557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c851d-13b5-4d9f-bac2-55290b963d4c None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:29:00.126157 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:29:00.151881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c851d-13b5-4d9f-bac2-55290b963d4c None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:29:00.189721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afb89a-3f5a-4090-8ea9-06c36919e5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:29:00.190377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afb89a-3f5a-4090-8ea9-06c36919e5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:29:00.190640 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afb89a-3f5a-4090-8ea9-06c36919e5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:29:00.190916 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afb89a-3f5a-4090-8ea9-06c36919e5b2 None admin] PATH_INFO: `/v3/services` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:29:00.191592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afb89a-3f5a-4090-8ea9-06c36919e5b2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:29:00.191933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afb89a-3f5a-4090-8ea9-06c36919e5b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:29:00.193290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afb89a-3f5a-4090-8ea9-06c36919e5b2 None admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:29:00.198291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 645/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Jul 25 21:29:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:29:00.204148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a642bbd-b70e-4ec5-b92a-b9c1eec1b4f3 None admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:29:00.306581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a642bbd-b70e-4ec5-b92a-b9c1eec1b4f3 None admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:29:00.339953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75bd30-929e-4680-b79b-956465204c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:29:00.340568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75bd30-929e-4680-b79b-956465204c6e None admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:29:00.340853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75bd30-929e-4680-b79b-956465204c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:29:00.341130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75bd30-929e-4680-b79b-956465204c6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:29:00.341840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75bd30-929e-4680-b79b-956465204c6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:29:00.343308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75bd30-929e-4680-b79b-956465204c6e None admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:29:00.429718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 661/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 21:29:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:29:10.240867 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=30 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:29:10.425225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:17.117449 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f876c0-7cef-43bf-9e19-89631c65c948 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:17.117924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f876c0-7cef-43bf-9e19-89631c65c948 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:17.118121 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f876c0-7cef-43bf-9e19-89631c65c948 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:17.121642 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 646/1307] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:35:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:35:17.126546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e7b18-65bd-4c14-876b-78eea9732794 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:17.126956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e7b18-65bd-4c14-876b-78eea9732794 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:17.127087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e7b18-65bd-4c14-876b-78eea9732794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:17.215224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-817e7b18-65bd-4c14-876b-78eea9732794 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:17.216443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-817e7b18-65bd-4c14-876b-78eea9732794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:17.332149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 662/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:17.387250 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427f3a9-654d-4d6a-a3e6-70592fa23a2a None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:17.387629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427f3a9-654d-4d6a-a3e6-70592fa23a2a None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:17.387876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427f3a9-654d-4d6a-a3e6-70592fa23a2a None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:17.390041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 647/1309] 10.222.0.27 () {54 vars in 965 bytes} [Mon Jul 25 21:35:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:35:17.396827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a7210-74d4-4533-ab78-ca7be260c565 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:17.397112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a7210-74d4-4533-ab78-ca7be260c565 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:17.397392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a7210-74d4-4533-ab78-ca7be260c565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:17.492813 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-412a7210-74d4-4533-ab78-ca7be260c565 None None] MFA Rules not processed for user `b428f7d0d62049cf8fbbd05830d0d356`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:17.494897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-412a7210-74d4-4533-ab78-ca7be260c565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:17.519488 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:17.580656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 663/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Mon Jul 25 21:35:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:17.590320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427f3a9-654d-4d6a-a3e6-70592fa23a2a None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:35:17.592071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-b427f3a9-654d-4d6a-a3e6-70592fa23a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:17.721414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427f3a9-654d-4d6a-a3e6-70592fa23a2a None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:35:17.921963 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94561250-5bba-49e7-b2b0-1428a2491d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:35:17.922592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94561250-5bba-49e7-b2b0-1428a2491d32 service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:17.922875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94561250-5bba-49e7-b2b0-1428a2491d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:17.923144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94561250-5bba-49e7-b2b0-1428a2491d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:17.924835 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-94561250-5bba-49e7-b2b0-1428a2491d32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:17.989665 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:18.051726 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94561250-5bba-49e7-b2b0-1428a2491d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:35:18.053220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94561250-5bba-49e7-b2b0-1428a2491d32 service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:35:18.074960 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 648/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:35:20.392844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538f9a-e90c-48e6-832a-1ee1a0db67a6 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:20.393404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538f9a-e90c-48e6-832a-1ee1a0db67a6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:20.393404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62538f9a-e90c-48e6-832a-1ee1a0db67a6 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:20.395027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 664/1312] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:35:20.401110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4cf7-4b15-4734-9cd4-72ed85adb3a8 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:20.401703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4cf7-4b15-4734-9cd4-72ed85adb3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:20.401703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab4cf7-4b15-4734-9cd4-72ed85adb3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:20.499451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-25ab4cf7-4b15-4734-9cd4-72ed85adb3a8 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:20.500770 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-25ab4cf7-4b15-4734-9cd4-72ed85adb3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:20.616897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 649/1313] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:20.656396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62538f9a-e90c-48e6-832a-1ee1a0db67a6 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:35:20.658074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-62538f9a-e90c-48e6-832a-1ee1a0db67a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:20.772977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62538f9a-e90c-48e6-832a-1ee1a0db67a6 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:35:20.852144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:20.855250 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c16e3-658f-452f-be1f-4ac4f89f7a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:35:20.855912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c16e3-658f-452f-be1f-4ac4f89f7a62 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:20.856198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c16e3-658f-452f-be1f-4ac4f89f7a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:20.856474 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c16e3-658f-452f-be1f-4ac4f89f7a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:20.858129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d50c16e3-658f-452f-be1f-4ac4f89f7a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:20.968111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c16e3-658f-452f-be1f-4ac4f89f7a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:35:20.969466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c16e3-658f-452f-be1f-4ac4f89f7a62 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:35:20.987764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 665/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:35:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:35:23.487432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f913cba-7922-41e7-a364-888a5b5889d3 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:23.488049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f913cba-7922-41e7-a364-888a5b5889d3 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:23.488049 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f913cba-7922-41e7-a364-888a5b5889d3 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:23.489329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 650/1315] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:35:23.494719 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023d012-9b33-4a95-bb11-d6b9a9fae20a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:23.498108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023d012-9b33-4a95-bb11-d6b9a9fae20a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:23.498108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023d012-9b33-4a95-bb11-d6b9a9fae20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:23.567022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8023d012-9b33-4a95-bb11-d6b9a9fae20a None None] MFA Rules not processed for user `0918a4fff7e7494b96471e61efa8a98f`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:23.568273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8023d012-9b33-4a95-bb11-d6b9a9fae20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:23.620233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:23.664086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 666/1316] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:35:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:23.705312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f913cba-7922-41e7-a364-888a5b5889d3 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:35:23.706837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-2f913cba-7922-41e7-a364-888a5b5889d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:23.717129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:23.811266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f913cba-7922-41e7-a364-888a5b5889d3 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:35:23.883765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba448d-d6c9-4137-a433-37dab8ebff63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:35:23.884910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba448d-d6c9-4137-a433-37dab8ebff63 service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:23.885619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba448d-d6c9-4137-a433-37dab8ebff63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:23.885898 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba448d-d6c9-4137-a433-37dab8ebff63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:23.887518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-eeba448d-d6c9-4137-a433-37dab8ebff63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:23.949764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:23.996696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba448d-d6c9-4137-a433-37dab8ebff63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:35:23.998112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba448d-d6c9-4137-a433-37dab8ebff63 service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:35:24.016845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 651/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:35:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:35:26.896199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387282e-fde9-4352-bfae-37ccfaf42bde None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:26.896743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387282e-fde9-4352-bfae-37ccfaf42bde None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:26.896743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387282e-fde9-4352-bfae-37ccfaf42bde None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:26.898115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 667/1318] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:35:26.904371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275a12-0820-43b7-8621-1a104af7db6d None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:26.904795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275a12-0820-43b7-8621-1a104af7db6d None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:26.904926 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26275a12-0820-43b7-8621-1a104af7db6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:26.976577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-26275a12-0820-43b7-8621-1a104af7db6d None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:26.977686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-26275a12-0820-43b7-8621-1a104af7db6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:27.075734 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 652/1319] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:35:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:27.114027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387282e-fde9-4352-bfae-37ccfaf42bde None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:35:27.115567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e387282e-fde9-4352-bfae-37ccfaf42bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:27.220389 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387282e-fde9-4352-bfae-37ccfaf42bde None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:35:27.294006 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23975ed-5bab-4751-89f8-040569741de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:35:27.294624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23975ed-5bab-4751-89f8-040569741de1 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:27.295162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23975ed-5bab-4751-89f8-040569741de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:27.295439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23975ed-5bab-4751-89f8-040569741de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:27.297106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e23975ed-5bab-4751-89f8-040569741de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:27.304460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:27.405366 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23975ed-5bab-4751-89f8-040569741de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:35:27.406792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23975ed-5bab-4751-89f8-040569741de1 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:35:27.425296 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 668/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:35:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:35:30.499648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f29bbc-c184-4ef2-a801-3a2434e87ea1 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:30.500219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f29bbc-c184-4ef2-a801-3a2434e87ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:30.500219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f29bbc-c184-4ef2-a801-3a2434e87ea1 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:30.501584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 653/1321] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:35:30.506855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115c388-9fdb-44d8-92dc-75eca0add820 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:30.507286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115c388-9fdb-44d8-92dc-75eca0add820 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:30.507415 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115c388-9fdb-44d8-92dc-75eca0add820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:30.577184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a115c388-9fdb-44d8-92dc-75eca0add820 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:30.578468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a115c388-9fdb-44d8-92dc-75eca0add820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:30.639231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:30.682775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 669/1322] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:30.720655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f29bbc-c184-4ef2-a801-3a2434e87ea1 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:35:30.722236 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-b0f29bbc-c184-4ef2-a801-3a2434e87ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:30.742735 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:30.836324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f29bbc-c184-4ef2-a801-3a2434e87ea1 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:35:30.912457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db911f6a-0540-4566-8fee-bbb865a850f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:35:30.913076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db911f6a-0540-4566-8fee-bbb865a850f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:30.913359 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db911f6a-0540-4566-8fee-bbb865a850f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:30.913633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db911f6a-0540-4566-8fee-bbb865a850f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:30.915259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-db911f6a-0540-4566-8fee-bbb865a850f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:30.987018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:31.025973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db911f6a-0540-4566-8fee-bbb865a850f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:35:31.027399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db911f6a-0540-4566-8fee-bbb865a850f6 service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:35:31.045740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 654/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:35:33.180276 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99c6c-ae5f-46f0-90fb-95b8bef0114a None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:33.180813 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99c6c-ae5f-46f0-90fb-95b8bef0114a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:33.180813 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99c6c-ae5f-46f0-90fb-95b8bef0114a None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:33.182903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 670/1324] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:35:33.188230 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba08be-a9b5-47bd-9143-ea6e57bc0a13 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:33.188677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba08be-a9b5-47bd-9143-ea6e57bc0a13 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:33.188795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba08be-a9b5-47bd-9143-ea6e57bc0a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:33.254517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-73ba08be-a9b5-47bd-9143-ea6e57bc0a13 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:33.255717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-73ba08be-a9b5-47bd-9143-ea6e57bc0a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:33.353834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 655/1325] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:33.390512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c99c6c-ae5f-46f0-90fb-95b8bef0114a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:35:33.392081 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-21c99c6c-ae5f-46f0-90fb-95b8bef0114a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:33.496976 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c99c6c-ae5f-46f0-90fb-95b8bef0114a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:35:33.574384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02a0be-29c5-449c-8d2e-3a0908c72a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:35:33.575027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02a0be-29c5-449c-8d2e-3a0908c72a0c service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:33.575314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02a0be-29c5-449c-8d2e-3a0908c72a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:33.575591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02a0be-29c5-449c-8d2e-3a0908c72a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:33.577367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ba02a0be-29c5-449c-8d2e-3a0908c72a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:33.597513 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:33.699472 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02a0be-29c5-449c-8d2e-3a0908c72a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:35:33.700944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02a0be-29c5-449c-8d2e-3a0908c72a0c service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:35:33.719481 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 671/1326] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:35:35.794518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88cf59-01ca-4c76-83de-2be84be74142 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:35.795293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88cf59-01ca-4c76-83de-2be84be74142 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:35.795293 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88cf59-01ca-4c76-83de-2be84be74142 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:35.796750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 656/1327] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:35:35.802050 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50dddd-4530-4046-9353-0d6bc49e5880 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:35.802474 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50dddd-4530-4046-9353-0d6bc49e5880 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:35.802637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50dddd-4530-4046-9353-0d6bc49e5880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:35.867875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-1d50dddd-4530-4046-9353-0d6bc49e5880 None None] MFA Rules not processed for user `0918a4fff7e7494b96471e61efa8a98f`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:35.869086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1d50dddd-4530-4046-9353-0d6bc49e5880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:35.936587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:35.970026 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 672/1328] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:35:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:36.016109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88cf59-01ca-4c76-83de-2be84be74142 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:35:36.017667 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-3d88cf59-01ca-4c76-83de-2be84be74142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:36.051001 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:36.124645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88cf59-01ca-4c76-83de-2be84be74142 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:35:36.199952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a7cbd-20f5-478e-88b0-358794a0b2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:35:36.200486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a7cbd-20f5-478e-88b0-358794a0b2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:36.200765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a7cbd-20f5-478e-88b0-358794a0b2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:36.201037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a7cbd-20f5-478e-88b0-358794a0b2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:36.202659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-ea0a7cbd-20f5-478e-88b0-358794a0b2a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:36.280621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:36.312648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a7cbd-20f5-478e-88b0-358794a0b2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:35:36.314092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a7cbd-20f5-478e-88b0-358794a0b2a1 service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:35:36.333282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 657/1329] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:35:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:35:38.809786 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540a9af-a634-44c2-a27f-4cef836593fc None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:38.810311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540a9af-a634-44c2-a27f-4cef836593fc None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:38.810435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540a9af-a634-44c2-a27f-4cef836593fc None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:38.811688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 673/1330] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:35:38.816745 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cd21c-c053-4d22-8eb9-0811f416799e None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:38.817129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cd21c-c053-4d22-8eb9-0811f416799e None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:38.817301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cd21c-c053-4d22-8eb9-0811f416799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:38.884798 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-208cd21c-c053-4d22-8eb9-0811f416799e None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:38.886041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-208cd21c-c053-4d22-8eb9-0811f416799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:38.985130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 658/1331] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:39.023532 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540a9af-a634-44c2-a27f-4cef836593fc None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:35:39.025883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c540a9af-a634-44c2-a27f-4cef836593fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:39.132894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540a9af-a634-44c2-a27f-4cef836593fc None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:35:39.206013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7a531-a92a-4dc8-af11-55fb3d5cf56f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:35:39.206646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7a531-a92a-4dc8-af11-55fb3d5cf56f service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:39.206909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7a531-a92a-4dc8-af11-55fb3d5cf56f service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:39.207176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7a531-a92a-4dc8-af11-55fb3d5cf56f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:39.208869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6cb7a531-a92a-4dc8-af11-55fb3d5cf56f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:39.237254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:39.320429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7a531-a92a-4dc8-af11-55fb3d5cf56f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:35:39.322918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7a531-a92a-4dc8-af11-55fb3d5cf56f service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:35:39.342098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 674/1332] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:35:41.418952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1a4f1-50e9-4a5c-87ae-fef256bd209d None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:41.419491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1a4f1-50e9-4a5c-87ae-fef256bd209d None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:41.419491 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1a4f1-50e9-4a5c-87ae-fef256bd209d None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:41.421140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 659/1333] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:35:41.426328 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3ccb3-c8b7-419f-9754-5a882f74b2cc None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:41.426734 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3ccb3-c8b7-419f-9754-5a882f74b2cc None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:41.426875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3ccb3-c8b7-419f-9754-5a882f74b2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:41.491754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-f1c3ccb3-c8b7-419f-9754-5a882f74b2cc None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:41.492950 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f1c3ccb3-c8b7-419f-9754-5a882f74b2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:41.568007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:41.591994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 675/1334] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:41.630903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1a4f1-50e9-4a5c-87ae-fef256bd209d None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:35:41.632509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-12a1a4f1-50e9-4a5c-87ae-fef256bd209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:41.673118 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:41.736264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1a4f1-50e9-4a5c-87ae-fef256bd209d None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:35:41.806738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc145f-95cb-44f1-b811-7c5ccd6e4154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:35:41.807368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc145f-95cb-44f1-b811-7c5ccd6e4154 service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:41.807622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc145f-95cb-44f1-b811-7c5ccd6e4154 service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:41.807922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc145f-95cb-44f1-b811-7c5ccd6e4154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:41.809520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-e3cc145f-95cb-44f1-b811-7c5ccd6e4154 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:41.891387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:41.916646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc145f-95cb-44f1-b811-7c5ccd6e4154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:35:41.918051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc145f-95cb-44f1-b811-7c5ccd6e4154 service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:35:41.936438 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 660/1335] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:35:44.589971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b478d58-19e3-4e23-bf60-81645a823352 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:44.590568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b478d58-19e3-4e23-bf60-81645a823352 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:44.590568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b478d58-19e3-4e23-bf60-81645a823352 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:44.591950 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 676/1336] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:35:44.597083 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fdd50-6042-4482-a050-ac7d9b7abf6e None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:44.597542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fdd50-6042-4482-a050-ac7d9b7abf6e None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:44.597684 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fdd50-6042-4482-a050-ac7d9b7abf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:44.666902 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-9f4fdd50-6042-4482-a050-ac7d9b7abf6e None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:44.668145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-9f4fdd50-6042-4482-a050-ac7d9b7abf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:44.764176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 661/1337] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:35:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:44.801128 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b478d58-19e3-4e23-bf60-81645a823352 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:35:44.802648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3b478d58-19e3-4e23-bf60-81645a823352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:44.905988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b478d58-19e3-4e23-bf60-81645a823352 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:35:44.977934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a0d69-d865-454e-8b4a-3dcaf2a43271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:35:44.978561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a0d69-d865-454e-8b4a-3dcaf2a43271 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:44.978825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a0d69-d865-454e-8b4a-3dcaf2a43271 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:44.979085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a0d69-d865-454e-8b4a-3dcaf2a43271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:44.980739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-598a0d69-d865-454e-8b4a-3dcaf2a43271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:45.015993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:45.089043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a0d69-d865-454e-8b4a-3dcaf2a43271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:35:45.090476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a0d69-d865-454e-8b4a-3dcaf2a43271 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:35:45.108550 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 677/1338] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:35:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:35:49.419846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e3fb4-7e2c-4e4d-ac26-6d8fd45446e9 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:49.420624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e3fb4-7e2c-4e4d-ac26-6d8fd45446e9 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:49.420624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e3fb4-7e2c-4e4d-ac26-6d8fd45446e9 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:49.422028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 662/1339] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:35:49.427375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885109a-a0b3-409b-9514-e87ca3a15b01 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:49.427853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885109a-a0b3-409b-9514-e87ca3a15b01 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:49.428051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885109a-a0b3-409b-9514-e87ca3a15b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:49.503564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-2885109a-a0b3-409b-9514-e87ca3a15b01 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:49.504834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-2885109a-a0b3-409b-9514-e87ca3a15b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:49.606689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:49.618594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 678/1340] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:49.658456 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e3fb4-7e2c-4e4d-ac26-6d8fd45446e9 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:35:49.660043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-d77e3fb4-7e2c-4e4d-ac26-6d8fd45446e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:49.714343 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:49.768950 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e3fb4-7e2c-4e4d-ac26-6d8fd45446e9 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:35:49.846346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c980e-ee28-415e-9440-bc087ffc281f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:35:49.847037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c980e-ee28-415e-9440-bc087ffc281f service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:49.847315 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c980e-ee28-415e-9440-bc087ffc281f service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:49.847587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c980e-ee28-415e-9440-bc087ffc281f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:49.849222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-eb2c980e-ee28-415e-9440-bc087ffc281f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:49.943299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:49.959636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c980e-ee28-415e-9440-bc087ffc281f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:35:49.961206 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c980e-ee28-415e-9440-bc087ffc281f service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:35:49.982002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 663/1341] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:35:52.977298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5d233-de4f-497e-984d-6d8315dfd02b None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:52.978641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5d233-de4f-497e-984d-6d8315dfd02b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:52.978641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5d233-de4f-497e-984d-6d8315dfd02b None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:52.979952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 679/1342] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:35:52.985192 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6930b-5d3b-4cdf-85af-7926ba43088f None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:52.985617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6930b-5d3b-4cdf-85af-7926ba43088f None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:52.985893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6930b-5d3b-4cdf-85af-7926ba43088f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:53.051403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-36b6930b-5d3b-4cdf-85af-7926ba43088f None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:53.052647 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-36b6930b-5d3b-4cdf-85af-7926ba43088f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:53.149553 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 664/1343] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:35:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:53.187935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5d233-de4f-497e-984d-6d8315dfd02b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:35:53.189514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-46f5d233-de4f-497e-984d-6d8315dfd02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:53.295808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5d233-de4f-497e-984d-6d8315dfd02b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:35:53.369509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04aac1-8093-4eab-847e-3a4f58b8ad5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:35:53.370134 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04aac1-8093-4eab-847e-3a4f58b8ad5f service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:53.370420 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04aac1-8093-4eab-847e-3a4f58b8ad5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:53.370697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04aac1-8093-4eab-847e-3a4f58b8ad5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:53.372350 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ce04aac1-8093-4eab-847e-3a4f58b8ad5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:53.416519 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:53.483890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04aac1-8093-4eab-847e-3a4f58b8ad5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:35:53.485335 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04aac1-8093-4eab-847e-3a4f58b8ad5f service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:35:53.504355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 680/1344] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:35:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:35:57.833792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb2448-3e6a-48d1-b1b8-5169a886135f None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:57.834278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb2448-3e6a-48d1-b1b8-5169a886135f None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:57.834394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb2448-3e6a-48d1-b1b8-5169a886135f None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:57.835701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 665/1345] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:35:57.841686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac91da-24ca-4ce1-a795-cd6dacdb8d8b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:57.842151 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac91da-24ca-4ce1-a795-cd6dacdb8d8b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:57.842247 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac91da-24ca-4ce1-a795-cd6dacdb8d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:57.912831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-08ac91da-24ca-4ce1-a795-cd6dacdb8d8b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:35:57.914086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-08ac91da-24ca-4ce1-a795-cd6dacdb8d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:58.015238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:58.019773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 681/1346] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:35:58.057123 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb2448-3e6a-48d1-b1b8-5169a886135f None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:35:58.058715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-e8bb2448-3e6a-48d1-b1b8-5169a886135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:58.120806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:58.172057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb2448-3e6a-48d1-b1b8-5169a886135f None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:35:58.249275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef61d0d-4481-4e36-b48b-1f9c60c6dd8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:35:58.249896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef61d0d-4481-4e36-b48b-1f9c60c6dd8c service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:35:58.250176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef61d0d-4481-4e36-b48b-1f9c60c6dd8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:35:58.250449 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef61d0d-4481-4e36-b48b-1f9c60c6dd8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:35:58.252085 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-cef61d0d-4481-4e36-b48b-1f9c60c6dd8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:35:58.363354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:35:58.367063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef61d0d-4481-4e36-b48b-1f9c60c6dd8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:35:58.369064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef61d0d-4481-4e36-b48b-1f9c60c6dd8c service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:35:58.387571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 666/1347] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:36:03.424974 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc73084-4758-4c55-b510-cf1a439a579b None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:03.425485 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc73084-4758-4c55-b510-cf1a439a579b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:03.425594 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc73084-4758-4c55-b510-cf1a439a579b None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:03.436686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 682/1348] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 21:36:03 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:03.441172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d13d83-cfab-4e87-a201-4f70970e7b00 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:03.441617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d13d83-cfab-4e87-a201-4f70970e7b00 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:03.441715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d13d83-cfab-4e87-a201-4f70970e7b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:03.526993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-f9d13d83-cfab-4e87-a201-4f70970e7b00 None None] MFA Rules not processed for user `6076b9f003c749348fcddef6f6ed28e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:03.528318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-f9d13d83-cfab-4e87-a201-4f70970e7b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:03.647858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 667/1349] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 21:36:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:07.722164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c724f-d2e2-4d02-8cac-5478ea011ea2 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:07.722714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c724f-d2e2-4d02-8cac-5478ea011ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:07.722714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c724f-d2e2-4d02-8cac-5478ea011ea2 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:07.724096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 683/1350] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 21:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:07.730094 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd001ca-7022-4d8e-a34b-5d5422f4fed5 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:07.730532 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd001ca-7022-4d8e-a34b-5d5422f4fed5 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:07.730730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd001ca-7022-4d8e-a34b-5d5422f4fed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:07.787429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:07.813426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-3fd001ca-7022-4d8e-a34b-5d5422f4fed5 None None] MFA Rules not processed for user `6076b9f003c749348fcddef6f6ed28e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:07.814625 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-3fd001ca-7022-4d8e-a34b-5d5422f4fed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:07.932409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 668/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 21:36:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:09.331390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe1e5c-7530-477c-a97c-724a79b9d430 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:09.331981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe1e5c-7530-477c-a97c-724a79b9d430 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:09.331981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe1e5c-7530-477c-a97c-724a79b9d430 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:09.333412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 684/1352] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 21:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:09.340184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba55a1-54ec-4d6d-afb8-8ee4e122e108 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:09.340641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba55a1-54ec-4d6d-afb8-8ee4e122e108 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:09.341037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba55a1-54ec-4d6d-afb8-8ee4e122e108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:09.421082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-75ba55a1-54ec-4d6d-afb8-8ee4e122e108 None None] MFA Rules not processed for user `6076b9f003c749348fcddef6f6ed28e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:09.422287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-75ba55a1-54ec-4d6d-afb8-8ee4e122e108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:09.464585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:09.530441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 669/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 21:36:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:13.060537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dcd06-5000-41c6-8824-e626cc890cf3 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:13.061672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dcd06-5000-41c6-8824-e626cc890cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:13.062215 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dcd06-5000-41c6-8824-e626cc890cf3 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:13.064216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 685/1354] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:13.071446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2594343-9109-4c46-9ac9-0132d62c4821 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:13.072575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2594343-9109-4c46-9ac9-0132d62c4821 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:13.073087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2594343-9109-4c46-9ac9-0132d62c4821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:13.145677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-b2594343-9109-4c46-9ac9-0132d62c4821 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:13.146981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-b2594343-9109-4c46-9ac9-0132d62c4821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:13.251857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 670/1355] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:13.313108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e1dc4-7ee3-480f-901d-a3794f7b9cc8 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:13.313716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e1dc4-7ee3-480f-901d-a3794f7b9cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:13.314235 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e1dc4-7ee3-480f-901d-a3794f7b9cc8 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:13.316097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 686/1356] 10.222.0.27 () {54 vars in 962 bytes} [Mon Jul 25 21:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:13.325689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eac505-2cdf-48bf-9730-0945fd09e138 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:13.330332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eac505-2cdf-48bf-9730-0945fd09e138 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:13.330332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eac505-2cdf-48bf-9730-0945fd09e138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:13.344413 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:13.408051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-14eac505-2cdf-48bf-9730-0945fd09e138 None None] MFA Rules not processed for user `7d3d6613476c445b82302df5025f3ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:13.409447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-14eac505-2cdf-48bf-9730-0945fd09e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:13.542617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 671/1357] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Jul 25 21:36:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:13.543424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e1dc4-7ee3-480f-901d-a3794f7b9cc8 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:13.544984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3b0e1dc4-7ee3-480f-901d-a3794f7b9cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:13.713256 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e1dc4-7ee3-480f-901d-a3794f7b9cc8 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:13.793509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:13.834910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2295b10-ae14-4d89-b72c-25a8e7495f1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:13.836826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295b10-ae14-4d89-b72c-25a8e7495f1d service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:13.837092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295b10-ae14-4d89-b72c-25a8e7495f1d service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:13.837351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295b10-ae14-4d89-b72c-25a8e7495f1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:13.839187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a2295b10-ae14-4d89-b72c-25a8e7495f1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:13.956282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2295b10-ae14-4d89-b72c-25a8e7495f1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:13.958034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2295b10-ae14-4d89-b72c-25a8e7495f1d service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:13.978961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 687/1358] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:36:16.249419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d4ec3-097c-4122-a3c6-4d476ad1dd35 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:16.249942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d4ec3-097c-4122-a3c6-4d476ad1dd35 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:16.249942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d4ec3-097c-4122-a3c6-4d476ad1dd35 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:16.251515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 672/1359] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:16.256615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaf2ef-a5a1-48bd-a089-7d8d92c9e6c5 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:16.257099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaf2ef-a5a1-48bd-a089-7d8d92c9e6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:16.257183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaf2ef-a5a1-48bd-a089-7d8d92c9e6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:16.330281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-acaaf2ef-a5a1-48bd-a089-7d8d92c9e6c5 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:16.331983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-acaaf2ef-a5a1-48bd-a089-7d8d92c9e6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:16.370792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:16.435601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 688/1360] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:16.483355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d4ec3-097c-4122-a3c6-4d476ad1dd35 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:16.484871 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-1e2d4ec3-097c-4122-a3c6-4d476ad1dd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:16.564977 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:16.665488 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d4ec3-097c-4122-a3c6-4d476ad1dd35 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:16.828077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257918c-cb8c-481c-98aa-688b3c2fc135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:16.828821 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257918c-cb8c-481c-98aa-688b3c2fc135 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:16.829230 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257918c-cb8c-481c-98aa-688b3c2fc135 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:16.829747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257918c-cb8c-481c-98aa-688b3c2fc135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:16.831565 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-0257918c-cb8c-481c-98aa-688b3c2fc135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:16.860056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:16.930580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257918c-cb8c-481c-98aa-688b3c2fc135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:16.932626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257918c-cb8c-481c-98aa-688b3c2fc135 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:16.952359 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 673/1361] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:36:19.486706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11722871-4ac1-40b6-b520-a9b660803dad None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:19.487223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11722871-4ac1-40b6-b520-a9b660803dad None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:19.487304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11722871-4ac1-40b6-b520-a9b660803dad None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:19.488811 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 689/1362] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:19.493959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6607f-6553-4beb-b217-3be149cc97d9 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:19.494417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6607f-6553-4beb-b217-3be149cc97d9 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:19.494511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6607f-6553-4beb-b217-3be149cc97d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:19.567078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-b4a6607f-6553-4beb-b217-3be149cc97d9 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:19.568267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-b4a6607f-6553-4beb-b217-3be149cc97d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:19.677452 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:19.683479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 674/1363] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:19.724090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79860374-7ee1-4663-ba5b-8a3a4690c47d None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:19.724435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79860374-7ee1-4663-ba5b-8a3a4690c47d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:19.724712 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79860374-7ee1-4663-ba5b-8a3a4690c47d None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:19.727300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 690/1364] 10.222.0.27 () {54 vars in 962 bytes} [Mon Jul 25 21:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:19.733374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb34220-7a43-4055-8dcb-015f09e78f71 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:19.733657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb34220-7a43-4055-8dcb-015f09e78f71 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:19.733939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb34220-7a43-4055-8dcb-015f09e78f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:19.822974 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-7fb34220-7a43-4055-8dcb-015f09e78f71 None None] MFA Rules not processed for user `7d3d6613476c445b82302df5025f3ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:19.824147 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-7fb34220-7a43-4055-8dcb-015f09e78f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:19.953502 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 675/1365] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Jul 25 21:36:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:19.961743 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79860374-7ee1-4663-ba5b-8a3a4690c47d None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:19.963410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-79860374-7ee1-4663-ba5b-8a3a4690c47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:20.125913 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79860374-7ee1-4663-ba5b-8a3a4690c47d None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:20.149816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:20.254338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c1731-00df-454f-9696-fbe0a2375c7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:20.254962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c1731-00df-454f-9696-fbe0a2375c7e service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:20.255245 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c1731-00df-454f-9696-fbe0a2375c7e service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:20.255520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c1731-00df-454f-9696-fbe0a2375c7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:20.257165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-115c1731-00df-454f-9696-fbe0a2375c7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:20.361122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c1731-00df-454f-9696-fbe0a2375c7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:20.362883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c1731-00df-454f-9696-fbe0a2375c7e service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:20.384607 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 691/1366] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:36:21.314315 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddcc7f-5ba9-4164-bcf6-0c4f1971806f None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:21.314887 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddcc7f-5ba9-4164-bcf6-0c4f1971806f None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:21.314887 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddcc7f-5ba9-4164-bcf6-0c4f1971806f None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:21.316431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 676/1367] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:21.322300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7e9bb-c30e-4852-b0e2-794aa4217f2a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:21.322715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7e9bb-c30e-4852-b0e2-794aa4217f2a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:21.322918 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7e9bb-c30e-4852-b0e2-794aa4217f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:21.356637 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:21.393697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-fcd7e9bb-c30e-4852-b0e2-794aa4217f2a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:21.394998 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fcd7e9bb-c30e-4852-b0e2-794aa4217f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:21.507250 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 692/1368] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:21.849954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293ca5a-a397-4326-b6d5-8f6ba243d210 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:21.850245 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293ca5a-a397-4326-b6d5-8f6ba243d210 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:21.850519 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293ca5a-a397-4326-b6d5-8f6ba243d210 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:21.852668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 677/1369] 10.222.0.27 () {54 vars in 964 bytes} [Mon Jul 25 21:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:21.857530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794734-d927-4c4a-8a44-624c26862818 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:21.857818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794734-d927-4c4a-8a44-624c26862818 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:21.858095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794734-d927-4c4a-8a44-624c26862818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:21.937025 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-73794734-d927-4c4a-8a44-624c26862818 None None] MFA Rules not processed for user `8ed104145f1f4a3aa76659ae6ceac4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:21.938236 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-73794734-d927-4c4a-8a44-624c26862818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:21.988492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:22.020543 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 693/1370] 10.222.0.27 () {58 vars in 1061 bytes} [Mon Jul 25 21:36:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:22.028639 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293ca5a-a397-4326-b6d5-8f6ba243d210 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:22.030152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-8293ca5a-a397-4326-b6d5-8f6ba243d210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:22.084142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:22.139437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293ca5a-a397-4326-b6d5-8f6ba243d210 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:22.217657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad625fa6-3b36-4ab9-8117-291b9aae0c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed104145f1f4a3aa76659ae6ceac4ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:22.218281 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad625fa6-3b36-4ab9-8117-291b9aae0c93 service cinder] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:22.218559 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad625fa6-3b36-4ab9-8117-291b9aae0c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:22.218829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad625fa6-3b36-4ab9-8117-291b9aae0c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:22.220517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-ad625fa6-3b36-4ab9-8117-291b9aae0c93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:22.331811 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:22.345428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad625fa6-3b36-4ab9-8117-291b9aae0c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:22.346899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad625fa6-3b36-4ab9-8117-291b9aae0c93 service cinder] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:22.366209 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 678/1371] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:36:22.711889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8accf-9c84-4cac-8bfa-bf148aef118c None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:22.712426 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8accf-9c84-4cac-8bfa-bf148aef118c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:22.712604 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8accf-9c84-4cac-8bfa-bf148aef118c None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:22.713920 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 694/1372] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:36:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:22.719457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b8154-7757-4cd3-9bff-1004b347d8ec None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:22.719784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b8154-7757-4cd3-9bff-1004b347d8ec None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:22.720078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b8154-7757-4cd3-9bff-1004b347d8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:22.797595 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-819b8154-7757-4cd3-9bff-1004b347d8ec None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:22.798930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-819b8154-7757-4cd3-9bff-1004b347d8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:22.897811 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 679/1373] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:22.942597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8accf-9c84-4cac-8bfa-bf148aef118c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:22.944158 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7cf8accf-9c84-4cac-8bfa-bf148aef118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:23.103248 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8accf-9c84-4cac-8bfa-bf148aef118c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:23.157695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:23.220669 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c1b34-d229-4979-8448-330d62bace71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:23.221319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c1b34-d229-4979-8448-330d62bace71 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:23.221608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c1b34-d229-4979-8448-330d62bace71 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:23.221962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c1b34-d229-4979-8448-330d62bace71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:23.223588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-771c1b34-d229-4979-8448-330d62bace71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:23.313441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c1b34-d229-4979-8448-330d62bace71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:23.315047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c1b34-d229-4979-8448-330d62bace71 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:23.333375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 695/1374] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:36:25.510620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2cbf-4c11-44a2-98f4-a9d57a91ec6a None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:25.511587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2cbf-4c11-44a2-98f4-a9d57a91ec6a None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:25.512110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2cbf-4c11-44a2-98f4-a9d57a91ec6a None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:25.513995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 680/1375] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:25.519822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aa82d-95e9-46f7-acb4-a48aa8433d0a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:25.520740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aa82d-95e9-46f7-acb4-a48aa8433d0a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:25.521223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aa82d-95e9-46f7-acb4-a48aa8433d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:25.589955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ac8aa82d-95e9-46f7-acb4-a48aa8433d0a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:25.591162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ac8aa82d-95e9-46f7-acb4-a48aa8433d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:25.597817 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:25.691679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 696/1376] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:25.734634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2cbf-4c11-44a2-98f4-a9d57a91ec6a None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:25.736225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-c7dc2cbf-4c11-44a2-98f4-a9d57a91ec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:25.797970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:25.892075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2cbf-4c11-44a2-98f4-a9d57a91ec6a None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:26.041882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccadadf-92d2-4f86-ab0f-727a1c0c70e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:26.042511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadadf-92d2-4f86-ab0f-727a1c0c70e2 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:26.042787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadadf-92d2-4f86-ab0f-727a1c0c70e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:26.043055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadadf-92d2-4f86-ab0f-727a1c0c70e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:26.044993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-6ccadadf-92d2-4f86-ab0f-727a1c0c70e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:26.070088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:26.163211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccadadf-92d2-4f86-ab0f-727a1c0c70e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:26.166048 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccadadf-92d2-4f86-ab0f-727a1c0c70e2 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:26.189239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 681/1377] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:36:28.442698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52306795-6f45-41cf-a332-bb9ec7308b29 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:28.443257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52306795-6f45-41cf-a332-bb9ec7308b29 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:28.443257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52306795-6f45-41cf-a332-bb9ec7308b29 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:28.444758 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 697/1378] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:28.450252 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f3282-42e7-4c39-b50e-8e45de30f705 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:28.450680 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f3282-42e7-4c39-b50e-8e45de30f705 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:28.450795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f3282-42e7-4c39-b50e-8e45de30f705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:28.522819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-a35f3282-42e7-4c39-b50e-8e45de30f705 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:28.525043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-a35f3282-42e7-4c39-b50e-8e45de30f705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:28.624862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:28.631065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 682/1379] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:28.679352 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52306795-6f45-41cf-a332-bb9ec7308b29 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:28.681722 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-52306795-6f45-41cf-a332-bb9ec7308b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:28.847975 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:28.860770 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52306795-6f45-41cf-a332-bb9ec7308b29 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:28.985326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece55a1-d629-4309-90dc-64e88e735e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:28.986033 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece55a1-d629-4309-90dc-64e88e735e82 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:28.986384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece55a1-d629-4309-90dc-64e88e735e82 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:28.986726 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece55a1-d629-4309-90dc-64e88e735e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:28.988440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3ece55a1-d629-4309-90dc-64e88e735e82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:29.084904 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece55a1-d629-4309-90dc-64e88e735e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:29.086855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece55a1-d629-4309-90dc-64e88e735e82 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:29.098140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:29.107083 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 698/1380] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:36:31.480011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe25b87-2fa2-4ef3-af7a-c0a82402cc1b None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:31.480577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe25b87-2fa2-4ef3-af7a-c0a82402cc1b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:31.480704 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe25b87-2fa2-4ef3-af7a-c0a82402cc1b None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:31.482241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 683/1381] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:31.488138 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206e23e-28f2-4639-9685-6d9d701e32cb None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:31.488541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206e23e-28f2-4639-9685-6d9d701e32cb None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:31.488938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206e23e-28f2-4639-9685-6d9d701e32cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:31.562910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-2206e23e-28f2-4639-9685-6d9d701e32cb None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:31.564167 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-2206e23e-28f2-4639-9685-6d9d701e32cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:31.662872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 699/1382] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:31.706765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe25b87-2fa2-4ef3-af7a-c0a82402cc1b None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:31.708837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-2fe25b87-2fa2-4ef3-af7a-c0a82402cc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:31.864056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe25b87-2fa2-4ef3-af7a-c0a82402cc1b None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:31.936629 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:31.996626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed6a08-f9d9-424b-9caa-84a33b8af659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:31.997274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6a08-f9d9-424b-9caa-84a33b8af659 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:31.997561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6a08-f9d9-424b-9caa-84a33b8af659 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:31.997843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6a08-f9d9-424b-9caa-84a33b8af659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:31.999630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-09ed6a08-f9d9-424b-9caa-84a33b8af659 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:32.096667 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed6a08-f9d9-424b-9caa-84a33b8af659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:32.098331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed6a08-f9d9-424b-9caa-84a33b8af659 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:32.119058 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 684/1383] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:36:34.175510 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdb7af-2700-4d06-b33f-ba88fcb085bd None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:34.176121 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdb7af-2700-4d06-b33f-ba88fcb085bd None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:34.176121 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdb7af-2700-4d06-b33f-ba88fcb085bd None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:34.177455 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 700/1384] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:34.183358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1e6a5-e4af-42e7-b65a-00bdeff50769 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:34.183993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1e6a5-e4af-42e7-b65a-00bdeff50769 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:34.183993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1e6a5-e4af-42e7-b65a-00bdeff50769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:34.253078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-05a1e6a5-e4af-42e7-b65a-00bdeff50769 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:34.254336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-05a1e6a5-e4af-42e7-b65a-00bdeff50769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:34.291064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:34.359795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 685/1385] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:36:34.404387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdb7af-2700-4d06-b33f-ba88fcb085bd None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:34.406075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-37fdb7af-2700-4d06-b33f-ba88fcb085bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:34.488133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:34.560051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdb7af-2700-4d06-b33f-ba88fcb085bd None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:34.678007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8826c-9267-44f0-8b4b-754c8d6a0a68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:34.678781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8826c-9267-44f0-8b4b-754c8d6a0a68 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:34.679125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8826c-9267-44f0-8b4b-754c8d6a0a68 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:34.680292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8826c-9267-44f0-8b4b-754c8d6a0a68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:34.682299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8db8826c-9267-44f0-8b4b-754c8d6a0a68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:34.733172 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:34.803407 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8826c-9267-44f0-8b4b-754c8d6a0a68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:34.807115 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8826c-9267-44f0-8b4b-754c8d6a0a68 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:34.833186 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 701/1386] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:36:37.101198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b301844-755a-428a-af78-b49bc9f764ae None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:37.101769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b301844-755a-428a-af78-b49bc9f764ae None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:37.101769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b301844-755a-428a-af78-b49bc9f764ae None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:37.103163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 686/1387] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:37.108317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f65d-9446-4c31-be5e-78dd5c627601 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:37.108750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f65d-9446-4c31-be5e-78dd5c627601 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:37.108910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421f65d-9446-4c31-be5e-78dd5c627601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:37.176605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-7421f65d-9446-4c31-be5e-78dd5c627601 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:37.177801 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7421f65d-9446-4c31-be5e-78dd5c627601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:37.279352 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 702/1388] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:37.324840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b301844-755a-428a-af78-b49bc9f764ae None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:37.326367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-0b301844-755a-428a-af78-b49bc9f764ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:37.474892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b301844-755a-428a-af78-b49bc9f764ae None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:37.490490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:37.590448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1a2d4-e750-4334-8d65-3aed5b962c09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:37.591077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1a2d4-e750-4334-8d65-3aed5b962c09 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:37.591361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1a2d4-e750-4334-8d65-3aed5b962c09 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:37.591634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1a2d4-e750-4334-8d65-3aed5b962c09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:37.593337 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-06a1a2d4-e750-4334-8d65-3aed5b962c09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:37.651495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49add6d-6c30-4e09-b82d-6e7373470a5c None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:37.651825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49add6d-6c30-4e09-b82d-6e7373470a5c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:37.652130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49add6d-6c30-4e09-b82d-6e7373470a5c None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:37.653511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 703/1389] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:36:37.658648 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7112e-e9e5-44b6-abfe-16a954e46b75 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:37.658935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7112e-e9e5-44b6-abfe-16a954e46b75 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:37.659211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7112e-e9e5-44b6-abfe-16a954e46b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:37.675132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:37.688074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1a2d4-e750-4334-8d65-3aed5b962c09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:37.690639 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1a2d4-e750-4334-8d65-3aed5b962c09 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:37.711193 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 687/1390] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:36:37.731481 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-53a7112e-e9e5-44b6-abfe-16a954e46b75 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:37.732663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-53a7112e-e9e5-44b6-abfe-16a954e46b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:37.832598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 704/1391] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:36:37.891179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382366e-a1c7-45b6-b0fa-a6a70498e76c None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:37.891468 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382366e-a1c7-45b6-b0fa-a6a70498e76c None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:37.891764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382366e-a1c7-45b6-b0fa-a6a70498e76c None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:37.893122 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 688/1392] 10.222.0.27 () {54 vars in 966 bytes} [Mon Jul 25 21:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:37.898745 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573686f-7b74-42ea-97a2-2683d5f33897 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:37.899030 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573686f-7b74-42ea-97a2-2683d5f33897 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:37.899305 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573686f-7b74-42ea-97a2-2683d5f33897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:37.984944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d573686f-7b74-42ea-97a2-2683d5f33897 None None] MFA Rules not processed for user `f4ceb49020974e89b264c2a874dd82cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:37.986112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d573686f-7b74-42ea-97a2-2683d5f33897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:38.026107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:38.072670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 705/1393] 10.222.0.27 () {58 vars in 1063 bytes} [Mon Jul 25 21:36:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:38.081518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382366e-a1c7-45b6-b0fa-a6a70498e76c None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:38.083950 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-e382366e-a1c7-45b6-b0fa-a6a70498e76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:38.108269 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:38.191322 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382366e-a1c7-45b6-b0fa-a6a70498e76c None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:38.267055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a210c4-fafa-4ff7-a5d9-169c15f303a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ceb49020974e89b264c2a874dd82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:38.267682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a210c4-fafa-4ff7-a5d9-169c15f303a8 service glance] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:38.267996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a210c4-fafa-4ff7-a5d9-169c15f303a8 service glance] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:38.268272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a210c4-fafa-4ff7-a5d9-169c15f303a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:38.269905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-30a210c4-fafa-4ff7-a5d9-169c15f303a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:38.344651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:38.381005 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a210c4-fafa-4ff7-a5d9-169c15f303a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:38.382523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a210c4-fafa-4ff7-a5d9-169c15f303a8 service glance] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:38.403844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 689/1394] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:36:39.333036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18345c-2928-4b9f-b842-579327e3802c None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:39.333516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18345c-2928-4b9f-b842-579327e3802c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:39.333661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18345c-2928-4b9f-b842-579327e3802c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:39.403879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-fd18345c-2928-4b9f-b842-579327e3802c None None] MFA Rules not processed for user `586e22d3792b4759a38ab4c3bc12cf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:39.405112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fd18345c-2928-4b9f-b842-579327e3802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:39.494052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 706/1395] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 21:36:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:39.538414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe01b2-cc37-4453-94af-5aac82456251 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:39.538899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe01b2-cc37-4453-94af-5aac82456251 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:39.539029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe01b2-cc37-4453-94af-5aac82456251 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:39.540383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 690/1396] 10.222.0.27 () {54 vars in 943 bytes} [Mon Jul 25 21:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:39.547210 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112132f-003b-4298-bc51-dae2f97ef8cd None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:39.547534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112132f-003b-4298-bc51-dae2f97ef8cd None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:39.548002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112132f-003b-4298-bc51-dae2f97ef8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:39.609713 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:39.628907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-b112132f-003b-4298-bc51-dae2f97ef8cd None None] MFA Rules not processed for user `4c4863a61a484ed4b0dac01e908cd05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:39.630774 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b112132f-003b-4298-bc51-dae2f97ef8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:39.741937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 707/1397] 10.222.0.27 () {58 vars in 1040 bytes} [Mon Jul 25 21:36:39 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:39.751639 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe01b2-cc37-4453-94af-5aac82456251 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:39.753198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-9ebe01b2-cc37-4453-94af-5aac82456251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:39.893372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe01b2-cc37-4453-94af-5aac82456251 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:39.935029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:39.946475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e15db3-8a87-431c-8e20-654f1bd8f33e None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:39.946475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e15db3-8a87-431c-8e20-654f1bd8f33e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:39.954564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e15db3-8a87-431c-8e20-654f1bd8f33e None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:39.954564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 708/1398] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:39.954564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb8c7c-5f9b-4e3d-b4fc-c8eb1efa8932 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:39.954564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb8c7c-5f9b-4e3d-b4fc-c8eb1efa8932 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:39.954564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb8c7c-5f9b-4e3d-b4fc-c8eb1efa8932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:39.998701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c34fe-49c4-4fb3-ae67-da240a523322 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4863a61a484ed4b0dac01e908cd05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:39.999246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c34fe-49c4-4fb3-ae67-da240a523322 service swift] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:39.999531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c34fe-49c4-4fb3-ae67-da240a523322 service swift] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:39.999829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c34fe-49c4-4fb3-ae67-da240a523322 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:40.001518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-bb3c34fe-49c4-4fb3-ae67-da240a523322 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:40.021635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-10bb8c7c-5f9b-4e3d-b4fc-c8eb1efa8932 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:40.022887 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-10bb8c7c-5f9b-4e3d-b4fc-c8eb1efa8932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:40.079991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:40.087323 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c34fe-49c4-4fb3-ae67-da240a523322 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:40.088939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c34fe-49c4-4fb3-ae67-da240a523322 service swift] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:40.097092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 691/1399] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 21:36:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:36:40.123996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 709/1400] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:36:40.168246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c34fe-49c4-4fb3-ae67-da240a523322 service swift] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:40.169448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-bb3c34fe-49c4-4fb3-ae67-da240a523322 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:40.240615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:40.264287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c34fe-49c4-4fb3-ae67-da240a523322 service swift] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:40.380375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6fd17-1f79-48e2-902c-ec620a28a0e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:40.381000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6fd17-1f79-48e2-902c-ec620a28a0e1 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:40.381287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6fd17-1f79-48e2-902c-ec620a28a0e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:40.381564 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6fd17-1f79-48e2-902c-ec620a28a0e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:40.383212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-79c6fd17-1f79-48e2-902c-ec620a28a0e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:40.485582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6fd17-1f79-48e2-902c-ec620a28a0e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:40.487352 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6fd17-1f79-48e2-902c-ec620a28a0e1 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:40.492389 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:40.508544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 692/1401] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:36:42.776979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7c793-b8b5-475c-9a0d-7faa219b0824 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:42.777575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7c793-b8b5-475c-9a0d-7faa219b0824 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:42.777575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7c793-b8b5-475c-9a0d-7faa219b0824 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:42.779187 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 710/1402] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:42.784778 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f692d-5d53-4319-bb63-fe226b8e5ff6 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:42.785273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f692d-5d53-4319-bb63-fe226b8e5ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:42.785376 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f692d-5d53-4319-bb63-fe226b8e5ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:42.864802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-904f692d-5d53-4319-bb63-fe226b8e5ff6 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:42.866005 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-904f692d-5d53-4319-bb63-fe226b8e5ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:42.985529 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 693/1403] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:43.041979 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7c793-b8b5-475c-9a0d-7faa219b0824 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:43.046592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-28e7c793-b8b5-475c-9a0d-7faa219b0824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:43.227166 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7c793-b8b5-475c-9a0d-7faa219b0824 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:43.274260 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:43.355550 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8be13a-d9f9-4ed9-8937-77c37671c463 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:43.356495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8be13a-d9f9-4ed9-8937-77c37671c463 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:43.356942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8be13a-d9f9-4ed9-8937-77c37671c463 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:43.357383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8be13a-d9f9-4ed9-8937-77c37671c463 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:43.359164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-bc8be13a-d9f9-4ed9-8937-77c37671c463 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:43.469200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8be13a-d9f9-4ed9-8937-77c37671c463 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:43.473587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8be13a-d9f9-4ed9-8937-77c37671c463 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:43.493043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 711/1404] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:36:45.768486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169520c-b10e-4580-aa9f-e460eaf9e19c None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:45.769061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169520c-b10e-4580-aa9f-e460eaf9e19c None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:45.769061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169520c-b10e-4580-aa9f-e460eaf9e19c None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:45.770624 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 694/1405] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:36:45.776385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3a63b-5b71-4a43-8805-c5c5e65f7ab8 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:45.776839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3a63b-5b71-4a43-8805-c5c5e65f7ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:45.776943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3a63b-5b71-4a43-8805-c5c5e65f7ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:45.845503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:45.854570 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-37d3a63b-5b71-4a43-8805-c5c5e65f7ab8 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:36:45.862208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-37d3a63b-5b71-4a43-8805-c5c5e65f7ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:45.971194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 712/1406] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:36:46.016355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169520c-b10e-4580-aa9f-e460eaf9e19c None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:36:46.017880 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-d169520c-b10e-4580-aa9f-e460eaf9e19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:46.110900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:46.194795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169520c-b10e-4580-aa9f-e460eaf9e19c None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:36:46.327778 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cfbc8-44a1-4f69-8997-889cc13cd757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:36:46.328419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cfbc8-44a1-4f69-8997-889cc13cd757 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:36:46.328699 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cfbc8-44a1-4f69-8997-889cc13cd757 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:36:46.328966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cfbc8-44a1-4f69-8997-889cc13cd757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:36:46.330601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-0a5cfbc8-44a1-4f69-8997-889cc13cd757 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:36:46.372846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:46.432261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cfbc8-44a1-4f69-8997-889cc13cd757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:36:46.433894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cfbc8-44a1-4f69-8997-889cc13cd757 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:36:46.457931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 695/1407] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:36:55.969390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=44 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:36:56.455219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=31 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:03.827499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e081c-2e96-4f13-84c7-7ac67e20e7a2 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:03.828079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e081c-2e96-4f13-84c7-7ac67e20e7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:03.828079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e081c-2e96-4f13-84c7-7ac67e20e7a2 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:03.829573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 713/1408] 10.222.0.27 () {54 vars in 918 bytes} [Mon Jul 25 21:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:03.834911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dd6c7-a7d6-49ad-a951-1283ad6b48de None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:03.835397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dd6c7-a7d6-49ad-a951-1283ad6b48de None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:03.835496 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dd6c7-a7d6-49ad-a951-1283ad6b48de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:03.911028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-9c1dd6c7-a7d6-49ad-a951-1283ad6b48de None None] MFA Rules not processed for user `6076b9f003c749348fcddef6f6ed28e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:03.912289 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-9c1dd6c7-a7d6-49ad-a951-1283ad6b48de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:04.018823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 696/1409] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Jul 25 21:37:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:04.033645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311f49-028e-44e5-a7d3-15a8a845ee65 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:04.033934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311f49-028e-44e5-a7d3-15a8a845ee65 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:04.034211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311f49-028e-44e5-a7d3-15a8a845ee65 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:04.035596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 714/1410] 10.222.0.27 () {54 vars in 918 bytes} [Mon Jul 25 21:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:04.040249 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c75bc-4b10-4a0d-9b3b-c2f3a9233f32 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:04.040540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c75bc-4b10-4a0d-9b3b-c2f3a9233f32 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:04.040820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c75bc-4b10-4a0d-9b3b-c2f3a9233f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:04.114230 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:04.117241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-295c75bc-4b10-4a0d-9b3b-c2f3a9233f32 None None] MFA Rules not processed for user `7d3d6613476c445b82302df5025f3ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:04.118446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-295c75bc-4b10-4a0d-9b3b-c2f3a9233f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:04.235291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 697/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Jul 25 21:37:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:06.719108 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34b35-f82d-4bcb-a805-79d4fe336879 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:06.719599 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34b35-f82d-4bcb-a805-79d4fe336879 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:06.719711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34b35-f82d-4bcb-a805-79d4fe336879 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:06.721062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 715/1412] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:06.726846 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a593ed2-2649-4945-9e93-621cc27caca3 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:06.727283 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a593ed2-2649-4945-9e93-621cc27caca3 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:06.727385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a593ed2-2649-4945-9e93-621cc27caca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:06.792146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-8a593ed2-2649-4945-9e93-621cc27caca3 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:06.793370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-8a593ed2-2649-4945-9e93-621cc27caca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:06.847820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:06.889894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 698/1413] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:06.932790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f34b35-f82d-4bcb-a805-79d4fe336879 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:06.934334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-70f34b35-f82d-4bcb-a805-79d4fe336879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:07.081706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f34b35-f82d-4bcb-a805-79d4fe336879 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:07.155286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:07.198597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ca388-e3c7-4395-b9ad-a494f64c8f20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:07.199223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ca388-e3c7-4395-b9ad-a494f64c8f20 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:07.199505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ca388-e3c7-4395-b9ad-a494f64c8f20 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:07.199808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ca388-e3c7-4395-b9ad-a494f64c8f20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:07.201569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-400ca388-e3c7-4395-b9ad-a494f64c8f20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:07.290726 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ca388-e3c7-4395-b9ad-a494f64c8f20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:07.292370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ca388-e3c7-4395-b9ad-a494f64c8f20 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:07.311170 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 716/1414] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:37:08.226419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d2d5d-1142-4b1b-a205-b8b67784b144 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:08.226991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d2d5d-1142-4b1b-a205-b8b67784b144 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:08.226991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d2d5d-1142-4b1b-a205-b8b67784b144 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:08.228348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 699/1415] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:37:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:08.233261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe5a7e-ec2f-41e2-a840-ebd5dbce9107 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:08.233687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe5a7e-ec2f-41e2-a840-ebd5dbce9107 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:08.233815 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe5a7e-ec2f-41e2-a840-ebd5dbce9107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:08.308494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-36fe5a7e-ec2f-41e2-a840-ebd5dbce9107 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:08.309695 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-36fe5a7e-ec2f-41e2-a840-ebd5dbce9107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:08.337184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:08.406683 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 717/1416] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:08.555928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d2d5d-1142-4b1b-a205-b8b67784b144 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:08.557497 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-243d2d5d-1142-4b1b-a205-b8b67784b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:08.703883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d2d5d-1142-4b1b-a205-b8b67784b144 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:08.743672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:08.816440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c1d8a-b92e-4c9d-93a9-e74119439536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:08.816981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c1d8a-b92e-4c9d-93a9-e74119439536 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:08.817262 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c1d8a-b92e-4c9d-93a9-e74119439536 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:08.817537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c1d8a-b92e-4c9d-93a9-e74119439536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:08.819164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-1f2c1d8a-b92e-4c9d-93a9-e74119439536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:08.909047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c1d8a-b92e-4c9d-93a9-e74119439536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:08.910635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c1d8a-b92e-4c9d-93a9-e74119439536 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:08.928414 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 700/1417] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:09.824298 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93f08c-8e59-4c07-a6ed-db4b0dd9ffa0 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:09.824897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93f08c-8e59-4c07-a6ed-db4b0dd9ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:09.824897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93f08c-8e59-4c07-a6ed-db4b0dd9ffa0 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:09.826213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 718/1418] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:09.831286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406755f-9603-46e2-9fb8-d27b5be3005d None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:09.831714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406755f-9603-46e2-9fb8-d27b5be3005d None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:09.831863 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406755f-9603-46e2-9fb8-d27b5be3005d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:09.886240 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:09.907650 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-0406755f-9603-46e2-9fb8-d27b5be3005d None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:09.908887 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-0406755f-9603-46e2-9fb8-d27b5be3005d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:10.004192 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 701/1419] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:10.154984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93f08c-8e59-4c07-a6ed-db4b0dd9ffa0 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:10.156558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-2b93f08c-8e59-4c07-a6ed-db4b0dd9ffa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:10.305387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93f08c-8e59-4c07-a6ed-db4b0dd9ffa0 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:10.317164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:10.419643 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bde3f0-1307-47ea-b046-9b30a06ccbaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:10.420314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde3f0-1307-47ea-b046-9b30a06ccbaa service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:10.420831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde3f0-1307-47ea-b046-9b30a06ccbaa service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:10.421110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bde3f0-1307-47ea-b046-9b30a06ccbaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:10.422738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e1bde3f0-1307-47ea-b046-9b30a06ccbaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:10.511226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bde3f0-1307-47ea-b046-9b30a06ccbaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:10.512862 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bde3f0-1307-47ea-b046-9b30a06ccbaa service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:10.530985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 719/1420] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:11.411450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33538edc-fb95-463a-bd06-0bee808909ec None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:11.412054 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33538edc-fb95-463a-bd06-0bee808909ec None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:11.412054 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33538edc-fb95-463a-bd06-0bee808909ec None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:11.413894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 702/1421] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:11.419091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c72e7e-48a6-4c9c-b202-eb4936c3a9cf None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:11.419611 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c72e7e-48a6-4c9c-b202-eb4936c3a9cf None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:11.419731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c72e7e-48a6-4c9c-b202-eb4936c3a9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:11.439923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:11.495286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-64c72e7e-48a6-4c9c-b202-eb4936c3a9cf None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:11.496528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-64c72e7e-48a6-4c9c-b202-eb4936c3a9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:11.590354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 720/1422] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:11.740210 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33538edc-fb95-463a-bd06-0bee808909ec None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:11.741745 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-33538edc-fb95-463a-bd06-0bee808909ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:11.850270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:11.892382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33538edc-fb95-463a-bd06-0bee808909ec None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:12.012062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8efc8-c014-4bdc-97dc-da2f3ecb1dea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:12.012678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8efc8-c014-4bdc-97dc-da2f3ecb1dea service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:12.012955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8efc8-c014-4bdc-97dc-da2f3ecb1dea service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:12.013225 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8efc8-c014-4bdc-97dc-da2f3ecb1dea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:12.016197 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-91f8efc8-c014-4bdc-97dc-da2f3ecb1dea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:12.093771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:12.107229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8efc8-c014-4bdc-97dc-da2f3ecb1dea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:12.108813 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8efc8-c014-4bdc-97dc-da2f3ecb1dea service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:12.127041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 703/1423] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:13.004425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718376c5-b21f-40f6-ac7f-09fc3b1de2c8 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:13.004939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718376c5-b21f-40f6-ac7f-09fc3b1de2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:13.005037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718376c5-b21f-40f6-ac7f-09fc3b1de2c8 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:13.006364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 721/1424] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:13.011559 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29797c2e-777c-4a24-8021-d7bbc89c039b None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:13.012020 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29797c2e-777c-4a24-8021-d7bbc89c039b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:13.012173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29797c2e-777c-4a24-8021-d7bbc89c039b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:13.087727 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-29797c2e-777c-4a24-8021-d7bbc89c039b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:13.088964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-29797c2e-777c-4a24-8021-d7bbc89c039b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:13.185152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 704/1425] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:13.335933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718376c5-b21f-40f6-ac7f-09fc3b1de2c8 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:13.337370 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-718376c5-b21f-40f6-ac7f-09fc3b1de2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:13.422106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:13.486442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718376c5-b21f-40f6-ac7f-09fc3b1de2c8 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:13.601314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde1329-9a24-4d74-8c73-b1b565792b65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:13.601857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1329-9a24-4d74-8c73-b1b565792b65 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:13.602139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1329-9a24-4d74-8c73-b1b565792b65 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:13.602413 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde1329-9a24-4d74-8c73-b1b565792b65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:13.604062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-acde1329-9a24-4d74-8c73-b1b565792b65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:13.653290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:13.695714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde1329-9a24-4d74-8c73-b1b565792b65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:13.697193 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde1329-9a24-4d74-8c73-b1b565792b65 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:13.715779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 722/1426] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:14.565214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a29d-8eb7-4edc-8eec-3b5784ff8e73 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:14.565989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a29d-8eb7-4edc-8eec-3b5784ff8e73 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:14.565989 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a29d-8eb7-4edc-8eec-3b5784ff8e73 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:14.567169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 705/1427] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:14.572499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ef63-8909-4ccf-8184-41506faa4131 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:14.573004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ef63-8909-4ccf-8184-41506faa4131 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:14.573125 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ef63-8909-4ccf-8184-41506faa4131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:14.652057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-34b9ef63-8909-4ccf-8184-41506faa4131 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:14.653257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-34b9ef63-8909-4ccf-8184-41506faa4131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:14.750473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 723/1428] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:14.901765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98a29d-8eb7-4edc-8eec-3b5784ff8e73 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:14.903290 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-dc98a29d-8eb7-4edc-8eec-3b5784ff8e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:14.951719 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:15.050249 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98a29d-8eb7-4edc-8eec-3b5784ff8e73 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:15.165154 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73392dda-aed3-4694-b7de-af2cc568d499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:15.165736 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392dda-aed3-4694-b7de-af2cc568d499 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:15.166043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392dda-aed3-4694-b7de-af2cc568d499 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:15.166339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392dda-aed3-4694-b7de-af2cc568d499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:15.168041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-73392dda-aed3-4694-b7de-af2cc568d499 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:15.175246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:15.257817 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73392dda-aed3-4694-b7de-af2cc568d499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:15.259398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73392dda-aed3-4694-b7de-af2cc568d499 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:15.277773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 706/1429] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:16.139309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8ebe7-5253-4182-8681-399f1e56b55d None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:16.139940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8ebe7-5253-4182-8681-399f1e56b55d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:16.139940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8ebe7-5253-4182-8681-399f1e56b55d None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:16.141248 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 724/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:16.146180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba64279-ce49-4294-b14e-a58b008053b1 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:16.146639 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba64279-ce49-4294-b14e-a58b008053b1 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:16.146754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba64279-ce49-4294-b14e-a58b008053b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:16.223515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-bba64279-ce49-4294-b14e-a58b008053b1 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:16.224771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-bba64279-ce49-4294-b14e-a58b008053b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:16.293879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:16.323423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 707/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:16.476074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8ebe7-5253-4182-8681-399f1e56b55d None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:16.477610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-31d8ebe7-5253-4182-8681-399f1e56b55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:16.496077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:16.626675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8ebe7-5253-4182-8681-399f1e56b55d None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:16.716996 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:16.742267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776ba97-c964-400c-b3e2-9f84cbff0ad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:16.742816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ba97-c964-400c-b3e2-9f84cbff0ad4 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:16.743094 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ba97-c964-400c-b3e2-9f84cbff0ad4 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:16.743366 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ba97-c964-400c-b3e2-9f84cbff0ad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:16.745009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3776ba97-c964-400c-b3e2-9f84cbff0ad4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:16.834203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776ba97-c964-400c-b3e2-9f84cbff0ad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:16.836573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776ba97-c964-400c-b3e2-9f84cbff0ad4 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:16.854683 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 725/1432] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:17.722999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e0907-85d5-4a41-b177-d76b0bd2896e None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:17.723484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e0907-85d5-4a41-b177-d76b0bd2896e None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:17.723590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e0907-85d5-4a41-b177-d76b0bd2896e None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:17.724942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 708/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:17.730875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf551-07c7-42b2-b0a1-4c5952c861dc None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:17.731341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf551-07c7-42b2-b0a1-4c5952c861dc None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:17.731442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf551-07c7-42b2-b0a1-4c5952c861dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:17.806984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-34cdf551-07c7-42b2-b0a1-4c5952c861dc None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:17.808221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-34cdf551-07c7-42b2-b0a1-4c5952c861dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:17.849705 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:17.904881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 726/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:18.054962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e0907-85d5-4a41-b177-d76b0bd2896e None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:18.056506 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-f70e0907-85d5-4a41-b177-d76b0bd2896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:18.203014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e0907-85d5-4a41-b177-d76b0bd2896e None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:18.257340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:18.317636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63773c-7535-4ed3-bda2-85a72c92d7c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:18.318212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63773c-7535-4ed3-bda2-85a72c92d7c7 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:18.318493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63773c-7535-4ed3-bda2-85a72c92d7c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:18.318793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63773c-7535-4ed3-bda2-85a72c92d7c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:18.321111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-0c63773c-7535-4ed3-bda2-85a72c92d7c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:18.410799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63773c-7535-4ed3-bda2-85a72c92d7c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:18.412479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63773c-7535-4ed3-bda2-85a72c92d7c7 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:18.431318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 709/1435] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:19.340173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd295a-424c-4cb9-8f74-9f699c5ceeda None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:19.340762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd295a-424c-4cb9-8f74-9f699c5ceeda None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:19.340762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd295a-424c-4cb9-8f74-9f699c5ceeda None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:19.342136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 727/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:19.346995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38970f9e-e4aa-4700-9df3-80b798e55565 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:19.347448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38970f9e-e4aa-4700-9df3-80b798e55565 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:19.347563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38970f9e-e4aa-4700-9df3-80b798e55565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:19.422834 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-38970f9e-e4aa-4700-9df3-80b798e55565 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:19.424079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-38970f9e-e4aa-4700-9df3-80b798e55565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:19.426070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:19.521386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 710/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:19.672030 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd295a-424c-4cb9-8f74-9f699c5ceeda None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:19.673558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-51bd295a-424c-4cb9-8f74-9f699c5ceeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:19.817772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd295a-424c-4cb9-8f74-9f699c5ceeda None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:19.844057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:19.932675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46520e-dffa-4e95-8abe-ce37b4b62ab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:19.933292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46520e-dffa-4e95-8abe-ce37b4b62ab8 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:19.933576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46520e-dffa-4e95-8abe-ce37b4b62ab8 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:19.933852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46520e-dffa-4e95-8abe-ce37b4b62ab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:19.935518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5d46520e-dffa-4e95-8abe-ce37b4b62ab8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:20.024155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46520e-dffa-4e95-8abe-ce37b4b62ab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:20.025772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46520e-dffa-4e95-8abe-ce37b4b62ab8 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:20.044046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 728/1438] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:21.982184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283d802-b4da-46b9-8124-f59fe86cddb0 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:21.982715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283d802-b4da-46b9-8124-f59fe86cddb0 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:21.982715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283d802-b4da-46b9-8124-f59fe86cddb0 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:21.984068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 711/1439] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:21.990575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedfc3b-db2f-48b0-9f5b-d71d5533df52 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:21.991239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedfc3b-db2f-48b0-9f5b-d71d5533df52 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:21.991792 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedfc3b-db2f-48b0-9f5b-d71d5533df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:22.034066 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:22.059149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ccedfc3b-db2f-48b0-9f5b-d71d5533df52 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:22.060396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ccedfc3b-db2f-48b0-9f5b-d71d5533df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:22.157662 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 729/1440] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:22.197698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283d802-b4da-46b9-8124-f59fe86cddb0 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:22.199267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-9283d802-b4da-46b9-8124-f59fe86cddb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:22.301710 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283d802-b4da-46b9-8124-f59fe86cddb0 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:22.334741 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:22.376615 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fe3d5-75fa-4393-adde-dcdcff16a6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:22.377238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fe3d5-75fa-4393-adde-dcdcff16a6ae service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:22.377521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fe3d5-75fa-4393-adde-dcdcff16a6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:22.377796 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fe3d5-75fa-4393-adde-dcdcff16a6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:22.379416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-110fe3d5-75fa-4393-adde-dcdcff16a6ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:22.486990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fe3d5-75fa-4393-adde-dcdcff16a6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:22.488473 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fe3d5-75fa-4393-adde-dcdcff16a6ae service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:22.508619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 712/1441] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:24.677609 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea9d3-3332-4401-bb7b-996d7653881e None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:24.678264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea9d3-3332-4401-bb7b-996d7653881e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:24.678264 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea9d3-3332-4401-bb7b-996d7653881e None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:24.680265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 730/1442] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:24.685552 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e675cb-28fa-4d2c-9fb3-c9604515f16a None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:24.685966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e675cb-28fa-4d2c-9fb3-c9604515f16a None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:24.686109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e675cb-28fa-4d2c-9fb3-c9604515f16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:24.750777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-e7e675cb-28fa-4d2c-9fb3-c9604515f16a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:24.752010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-e7e675cb-28fa-4d2c-9fb3-c9604515f16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:24.765138 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:24.848273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 713/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:24.886352 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ea9d3-3332-4401-bb7b-996d7653881e None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:24.887958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-487ea9d3-3332-4401-bb7b-996d7653881e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:24.996980 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ea9d3-3332-4401-bb7b-996d7653881e None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:25.009691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:25.071716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cdb5f-d48b-4d5a-b8b5-6c7b72d6ef9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:25.072340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cdb5f-d48b-4d5a-b8b5-6c7b72d6ef9c service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:25.072621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cdb5f-d48b-4d5a-b8b5-6c7b72d6ef9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:25.072895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cdb5f-d48b-4d5a-b8b5-6c7b72d6ef9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:25.074507 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-766cdb5f-d48b-4d5a-b8b5-6c7b72d6ef9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:25.184660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cdb5f-d48b-4d5a-b8b5-6c7b72d6ef9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:25.186097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cdb5f-d48b-4d5a-b8b5-6c7b72d6ef9c service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:25.204396 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 731/1444] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:27.593552 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9833cc2-260e-4c9b-9e93-229fb710332e None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:27.594117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9833cc2-260e-4c9b-9e93-229fb710332e None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:27.594117 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9833cc2-260e-4c9b-9e93-229fb710332e None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:27.595444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 714/1445] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:27.600907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e4c05-9cd6-4d34-97c1-461d812da60f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:27.601346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e4c05-9cd6-4d34-97c1-461d812da60f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:27.601451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e4c05-9cd6-4d34-97c1-461d812da60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:27.769891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:27.788423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-543e4c05-9cd6-4d34-97c1-461d812da60f None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:27.789638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-543e4c05-9cd6-4d34-97c1-461d812da60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:27.885869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 732/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:27.924808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9833cc2-260e-4c9b-9e93-229fb710332e None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:27.926354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-a9833cc2-260e-4c9b-9e93-229fb710332e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:28.039999 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9833cc2-260e-4c9b-9e93-229fb710332e None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:28.080487 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:28.113200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a1c98-b7af-4e12-8237-ee6fb4af4c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:28.113820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a1c98-b7af-4e12-8237-ee6fb4af4c9d service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:28.114103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a1c98-b7af-4e12-8237-ee6fb4af4c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:28.114378 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a1c98-b7af-4e12-8237-ee6fb4af4c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:28.116668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-a33a1c98-b7af-4e12-8237-ee6fb4af4c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:28.226906 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a1c98-b7af-4e12-8237-ee6fb4af4c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:28.228275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a1c98-b7af-4e12-8237-ee6fb4af4c9d service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:28.246697 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 715/1447] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:30.390303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792eb006-a2db-443c-9608-b33ced8b7dd1 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:30.390896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792eb006-a2db-443c-9608-b33ced8b7dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:30.390896 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792eb006-a2db-443c-9608-b33ced8b7dd1 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:30.392266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 733/1448] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:30.397555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98ccf3-3b6a-442f-96c9-d7a8087f08d2 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:30.398005 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98ccf3-3b6a-442f-96c9-d7a8087f08d2 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:30.398119 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98ccf3-3b6a-442f-96c9-d7a8087f08d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:30.464777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-4c98ccf3-3b6a-442f-96c9-d7a8087f08d2 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:30.465982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-4c98ccf3-3b6a-442f-96c9-d7a8087f08d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:30.486754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:30.562765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 716/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:30.602316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792eb006-a2db-443c-9608-b33ced8b7dd1 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:30.603888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-792eb006-a2db-443c-9608-b33ced8b7dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:30.707670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792eb006-a2db-443c-9608-b33ced8b7dd1 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:30.728320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:30.781595 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122c771-f127-4850-9ad0-7132cae8d118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:30.782211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122c771-f127-4850-9ad0-7132cae8d118 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:30.782494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122c771-f127-4850-9ad0-7132cae8d118 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:30.782765 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122c771-f127-4850-9ad0-7132cae8d118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:30.784418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6122c771-f127-4850-9ad0-7132cae8d118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:30.892403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122c771-f127-4850-9ad0-7132cae8d118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:30.893841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122c771-f127-4850-9ad0-7132cae8d118 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:30.913137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 734/1450] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:33.095933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4207403-1067-47d5-8faa-528a7a99ec09 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:33.096508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4207403-1067-47d5-8faa-528a7a99ec09 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:33.096508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4207403-1067-47d5-8faa-528a7a99ec09 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:33.097836 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 717/1451] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:33.103689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b82b89-ef21-48e1-ad17-9165f77c4ed7 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:33.104131 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b82b89-ef21-48e1-ad17-9165f77c4ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:33.104316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b82b89-ef21-48e1-ad17-9165f77c4ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:33.167893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:33.171033 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-d4b82b89-ef21-48e1-ad17-9165f77c4ed7 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:33.172295 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d4b82b89-ef21-48e1-ad17-9165f77c4ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:33.267160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 735/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:33.308178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4207403-1067-47d5-8faa-528a7a99ec09 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:33.309747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-f4207403-1067-47d5-8faa-528a7a99ec09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:33.414097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4207403-1067-47d5-8faa-528a7a99ec09 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:33.462869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:33.487760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac8460-6ab8-4e67-8f61-9d5f5ede3464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:33.488409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac8460-6ab8-4e67-8f61-9d5f5ede3464 service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:33.488690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac8460-6ab8-4e67-8f61-9d5f5ede3464 service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:33.488962 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac8460-6ab8-4e67-8f61-9d5f5ede3464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:33.491229 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-2bac8460-6ab8-4e67-8f61-9d5f5ede3464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:33.600967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac8460-6ab8-4e67-8f61-9d5f5ede3464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:33.602454 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac8460-6ab8-4e67-8f61-9d5f5ede3464 service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:33.623308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 718/1453] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:35.724574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd822e-058b-4879-8f9b-40548cc43111 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:35.725198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd822e-058b-4879-8f9b-40548cc43111 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:35.725198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd822e-058b-4879-8f9b-40548cc43111 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:35.726646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 736/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:35.732020 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38044f09-67e6-46ee-b136-ecc7c1367d21 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:35.732432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38044f09-67e6-46ee-b136-ecc7c1367d21 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:35.732576 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38044f09-67e6-46ee-b136-ecc7c1367d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:35.797308 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-38044f09-67e6-46ee-b136-ecc7c1367d21 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:35.798503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-38044f09-67e6-46ee-b136-ecc7c1367d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:35.828071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:35.899133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 719/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:35.937128 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd822e-058b-4879-8f9b-40548cc43111 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:35.938653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-11fd822e-058b-4879-8f9b-40548cc43111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:36.046728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd822e-058b-4879-8f9b-40548cc43111 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:36.075391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:36.120881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b1bf9-bed6-4b4e-815e-23a9f64cbdc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:36.121505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b1bf9-bed6-4b4e-815e-23a9f64cbdc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:36.121788 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b1bf9-bed6-4b4e-815e-23a9f64cbdc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:36.122060 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b1bf9-bed6-4b4e-815e-23a9f64cbdc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:36.123680 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a73b1bf9-bed6-4b4e-815e-23a9f64cbdc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:36.234464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b1bf9-bed6-4b4e-815e-23a9f64cbdc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:36.235924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b1bf9-bed6-4b4e-815e-23a9f64cbdc0 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:36.255163 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 737/1456] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:38.320181 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a610b5-e080-4b37-87fb-0bcc40dc7620 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:38.320761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a610b5-e080-4b37-87fb-0bcc40dc7620 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:38.320761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a610b5-e080-4b37-87fb-0bcc40dc7620 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:38.322091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 720/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:38.327614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce450541-c39f-4d73-b940-01eb4f2d3778 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:38.328071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce450541-c39f-4d73-b940-01eb4f2d3778 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:38.328261 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce450541-c39f-4d73-b940-01eb4f2d3778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:38.394074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ce450541-c39f-4d73-b940-01eb4f2d3778 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:38.395317 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ce450541-c39f-4d73-b940-01eb4f2d3778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:38.404203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:38.491988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 738/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:38.530175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a610b5-e080-4b37-87fb-0bcc40dc7620 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:38.531718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-68a610b5-e080-4b37-87fb-0bcc40dc7620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:38.636817 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a610b5-e080-4b37-87fb-0bcc40dc7620 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:38.692860 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:38.711397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80cd5a-8ae0-4d18-8cb9-090da893643f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:38.712055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80cd5a-8ae0-4d18-8cb9-090da893643f service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:38.712334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80cd5a-8ae0-4d18-8cb9-090da893643f service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:38.712602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80cd5a-8ae0-4d18-8cb9-090da893643f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:38.714221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-0d80cd5a-8ae0-4d18-8cb9-090da893643f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:38.822672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80cd5a-8ae0-4d18-8cb9-090da893643f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:38.824138 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80cd5a-8ae0-4d18-8cb9-090da893643f service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:38.843490 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 721/1459] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:40.931826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a4c18-cbd1-4d03-930c-0cb704d081eb None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:40.932312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a4c18-cbd1-4d03-930c-0cb704d081eb None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:40.932417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a4c18-cbd1-4d03-930c-0cb704d081eb None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:40.933756 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 739/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:40.939141 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15594d-a19f-4b00-8bfe-061e0badea0b None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:40.939614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15594d-a19f-4b00-8bfe-061e0badea0b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:40.939713 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15594d-a19f-4b00-8bfe-061e0badea0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:41.006713 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-1a15594d-a19f-4b00-8bfe-061e0badea0b None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:41.007949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-1a15594d-a19f-4b00-8bfe-061e0badea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:41.046249 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:41.104739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 722/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:41.142077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a4c18-cbd1-4d03-930c-0cb704d081eb None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:41.143606 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-794a4c18-cbd1-4d03-930c-0cb704d081eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:41.247349 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a4c18-cbd1-4d03-930c-0cb704d081eb None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:41.286091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:41.323171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c46f57-2f8e-4192-ba00-1afce05cccc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:41.323806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c46f57-2f8e-4192-ba00-1afce05cccc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:41.324088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c46f57-2f8e-4192-ba00-1afce05cccc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:41.324360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c46f57-2f8e-4192-ba00-1afce05cccc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:41.325967 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a7c46f57-2f8e-4192-ba00-1afce05cccc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:41.434916 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c46f57-2f8e-4192-ba00-1afce05cccc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:41.436395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c46f57-2f8e-4192-ba00-1afce05cccc9 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:41.455338 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 740/1462] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:43.469169 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688b6d-2889-40f5-beb8-5d70a63c0532 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:43.469712 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688b6d-2889-40f5-beb8-5d70a63c0532 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:43.469712 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71688b6d-2889-40f5-beb8-5d70a63c0532 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:43.471070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 723/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:43.477046 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d2a4-c45e-4e07-bbdf-f778d4bc7571 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:43.477462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d2a4-c45e-4e07-bbdf-f778d4bc7571 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:43.477593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d2a4-c45e-4e07-bbdf-f778d4bc7571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:43.545824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-09d4d2a4-c45e-4e07-bbdf-f778d4bc7571 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:43.547047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-09d4d2a4-c45e-4e07-bbdf-f778d4bc7571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:43.568775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:43.650453 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 741/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:43.689400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71688b6d-2889-40f5-beb8-5d70a63c0532 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:43.690948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-71688b6d-2889-40f5-beb8-5d70a63c0532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:43.796689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71688b6d-2889-40f5-beb8-5d70a63c0532 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:43.870828 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:43.872142 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2efe90-44c9-4b4a-b106-cb2133d3e0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:43.872766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2efe90-44c9-4b4a-b106-cb2133d3e0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:43.873045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2efe90-44c9-4b4a-b106-cb2133d3e0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:43.873318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2efe90-44c9-4b4a-b106-cb2133d3e0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:43.875143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-3c2efe90-44c9-4b4a-b106-cb2133d3e0b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:43.989451 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2efe90-44c9-4b4a-b106-cb2133d3e0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:43.991112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2efe90-44c9-4b4a-b106-cb2133d3e0b6 service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:44.010377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 724/1465] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:46.027254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278bead-ecc9-4cce-b300-1dc95ad3505c None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:46.027897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278bead-ecc9-4cce-b300-1dc95ad3505c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:46.027897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278bead-ecc9-4cce-b300-1dc95ad3505c None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:46.029189 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 742/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:46.034341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56662f73-fa80-47e7-8417-b625fa6f2481 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:46.034762 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56662f73-fa80-47e7-8417-b625fa6f2481 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:46.034877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56662f73-fa80-47e7-8417-b625fa6f2481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:46.102706 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-56662f73-fa80-47e7-8417-b625fa6f2481 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:46.103939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-56662f73-fa80-47e7-8417-b625fa6f2481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:46.151747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:46.201537 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 725/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:46.254217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca9abd-377f-418b-ad61-ac4d85de1067 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:46.254504 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca9abd-377f-418b-ad61-ac4d85de1067 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:46.254780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca9abd-377f-418b-ad61-ac4d85de1067 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:46.256235 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 743/1468] 10.222.0.27 () {54 vars in 965 bytes} [Mon Jul 25 21:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:37:46.262127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef61c5a-2999-4a20-9864-72b857c31c7e None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:46.262417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef61c5a-2999-4a20-9864-72b857c31c7e None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:46.262691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef61c5a-2999-4a20-9864-72b857c31c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:46.342389 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-6ef61c5a-2999-4a20-9864-72b857c31c7e None None] MFA Rules not processed for user `b428f7d0d62049cf8fbbd05830d0d356`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:37:46.343608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-6ef61c5a-2999-4a20-9864-72b857c31c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:46.422092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 726/1469] 10.222.0.27 () {58 vars in 1062 bytes} [Mon Jul 25 21:37:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:37:46.431894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca9abd-377f-418b-ad61-ac4d85de1067 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:37:46.433425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-deca9abd-377f-418b-ad61-ac4d85de1067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:46.538253 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca9abd-377f-418b-ad61-ac4d85de1067 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:37:46.586153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:46.614257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e68f32-39be-40f3-bff3-eb027b457c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:37:46.614876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e68f32-39be-40f3-bff3-eb027b457c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:37:46.615357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e68f32-39be-40f3-bff3-eb027b457c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:37:46.615900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e68f32-39be-40f3-bff3-eb027b457c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:37:46.618153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d8e68f32-39be-40f3-bff3-eb027b457c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:37:46.726938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e68f32-39be-40f3-bff3-eb027b457c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:37:46.728429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e68f32-39be-40f3-bff3-eb027b457c84 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:37:46.746505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 744/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:37:56.419933 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=81 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:37:56.744200 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=66 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:06.975958 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc64d4d-335b-4183-bd1f-2e8786168987 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:06.976465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc64d4d-335b-4183-bd1f-2e8786168987 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:06.976465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc64d4d-335b-4183-bd1f-2e8786168987 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:06.977818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 727/1471] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:38:06.983050 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c01f1-fb59-4e45-8ca6-bce06dff1093 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:06.983482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c01f1-fb59-4e45-8ca6-bce06dff1093 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:06.983587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c01f1-fb59-4e45-8ca6-bce06dff1093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:07.050292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-fa4c01f1-fb59-4e45-8ca6-bce06dff1093 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:38:07.051503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fa4c01f1-fb59-4e45-8ca6-bce06dff1093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:07.147178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 745/1472] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:38:07.231675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513a285-c9d0-4b31-9f78-23ca4cc81d07 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:07.232078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513a285-c9d0-4b31-9f78-23ca4cc81d07 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:07.232265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513a285-c9d0-4b31-9f78-23ca4cc81d07 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:07.233651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 728/1473] 10.222.0.27 () {54 vars in 966 bytes} [Mon Jul 25 21:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:38:07.238547 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b084e3-d6bf-4a8d-95c8-b370cc17d7d4 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:07.238840 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b084e3-d6bf-4a8d-95c8-b370cc17d7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:07.239118 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b084e3-d6bf-4a8d-95c8-b370cc17d7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:07.315444 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-54b084e3-d6bf-4a8d-95c8-b370cc17d7d4 None None] MFA Rules not processed for user `f4ceb49020974e89b264c2a874dd82cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:38:07.316760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-54b084e3-d6bf-4a8d-95c8-b370cc17d7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:07.339642 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:07.397016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 746/1474] 10.222.0.27 () {58 vars in 1063 bytes} [Mon Jul 25 21:38:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:38:07.404716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513a285-c9d0-4b31-9f78-23ca4cc81d07 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:38:07.406299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-d513a285-c9d0-4b31-9f78-23ca4cc81d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:07.510869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513a285-c9d0-4b31-9f78-23ca4cc81d07 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:38:07.584161 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59946c-1bc1-4ee1-b9e7-9f174433e6aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ceb49020974e89b264c2a874dd82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:38:07.584773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59946c-1bc1-4ee1-b9e7-9f174433e6aa service glance] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:07.585055 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59946c-1bc1-4ee1-b9e7-9f174433e6aa service glance] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:07.585330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59946c-1bc1-4ee1-b9e7-9f174433e6aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:07.586951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-5d59946c-1bc1-4ee1-b9e7-9f174433e6aa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:07.640164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:07.697050 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59946c-1bc1-4ee1-b9e7-9f174433e6aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:38:07.698475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59946c-1bc1-4ee1-b9e7-9f174433e6aa service glance] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:38:07.717555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 729/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:38:09.827000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5437090-17ba-4308-a201-3f14273519bd None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:09.827565 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5437090-17ba-4308-a201-3f14273519bd None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:09.827565 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5437090-17ba-4308-a201-3f14273519bd None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:09.828949 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 747/1476] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:38:09.834942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e875e-ef99-4ae6-b386-71f8490dbf84 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:09.835352 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e875e-ef99-4ae6-b386-71f8490dbf84 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:09.835486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e875e-ef99-4ae6-b386-71f8490dbf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:09.901287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-073e875e-ef99-4ae6-b386-71f8490dbf84 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:38:09.902505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-073e875e-ef99-4ae6-b386-71f8490dbf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:10.000526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 730/1477] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:38:10.024238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5437090-17ba-4308-a201-3f14273519bd None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:38:10.025780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-d5437090-17ba-4308-a201-3f14273519bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:10.151632 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5437090-17ba-4308-a201-3f14273519bd None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:38:10.200316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:10.244043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7706e-1b5d-49e8-9957-5f5a4688f334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:38:10.244663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7706e-1b5d-49e8-9957-5f5a4688f334 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:10.244942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7706e-1b5d-49e8-9957-5f5a4688f334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:10.245211 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7706e-1b5d-49e8-9957-5f5a4688f334 admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:10.245910 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7706e-1b5d-49e8-9957-5f5a4688f334 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:38:10.247618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: WARNING py.warnings [None req-1ba7706e-1b5d-49e8-9957-5f5a4688f334 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:38:10.247618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: warnings.warn(msg) Jul 25 21:38:10.247618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: Jul 25 21:38:10.248775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7706e-1b5d-49e8-9957-5f5a4688f334 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:38:10.268988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 748/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 25 21:38:10 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:38:12.345219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf1f3c-3450-43ba-a52c-f57118dfc304 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:12.345757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf1f3c-3450-43ba-a52c-f57118dfc304 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:12.345851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf1f3c-3450-43ba-a52c-f57118dfc304 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:12.347217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 731/1479] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:38:12.352843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c60467-2983-437a-8863-be2952852696 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:12.353276 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c60467-2983-437a-8863-be2952852696 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:12.353382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c60467-2983-437a-8863-be2952852696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:12.420196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-91c60467-2983-437a-8863-be2952852696 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:38:12.421669 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-91c60467-2983-437a-8863-be2952852696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:12.517173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 749/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:38:12.561202 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf1f3c-3450-43ba-a52c-f57118dfc304 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:38:12.562730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-7ecf1f3c-3450-43ba-a52c-f57118dfc304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:12.572700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:12.708754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf1f3c-3450-43ba-a52c-f57118dfc304 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:38:12.788666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:12.820113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f6456-e69a-4cc3-a506-93cc96b80dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:38:12.820730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f6456-e69a-4cc3-a506-93cc96b80dd9 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:12.821013 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f6456-e69a-4cc3-a506-93cc96b80dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:12.821287 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f6456-e69a-4cc3-a506-93cc96b80dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:12.822916 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-e76f6456-e69a-4cc3-a506-93cc96b80dd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:12.913303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f6456-e69a-4cc3-a506-93cc96b80dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:38:12.914888 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f6456-e69a-4cc3-a506-93cc96b80dd9 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:38:12.933450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 732/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:38:15.133104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247d281-393c-4557-99bc-172526867b38 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:15.133634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247d281-393c-4557-99bc-172526867b38 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:15.133634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247d281-393c-4557-99bc-172526867b38 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:15.135039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 750/1482] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:38:15.140300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd3dcb-abb6-4081-8776-d5e073caa405 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:15.140709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd3dcb-abb6-4081-8776-d5e073caa405 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:15.140857 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd3dcb-abb6-4081-8776-d5e073caa405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:15.206487 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-7cfd3dcb-abb6-4081-8776-d5e073caa405 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:38:15.207679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-7cfd3dcb-abb6-4081-8776-d5e073caa405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:15.253852 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:15.303985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 733/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:38:15.340929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247d281-393c-4557-99bc-172526867b38 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:38:15.342447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b247d281-393c-4557-99bc-172526867b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:15.366322 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:15.447237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247d281-393c-4557-99bc-172526867b38 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:38:15.522505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede4310-3d4a-47e7-8207-3befcd597c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:38:15.523045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede4310-3d4a-47e7-8207-3befcd597c6c service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:15.523327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede4310-3d4a-47e7-8207-3befcd597c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:15.523602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede4310-3d4a-47e7-8207-3befcd597c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:15.525259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7ede4310-3d4a-47e7-8207-3befcd597c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:15.601788 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:15.637891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede4310-3d4a-47e7-8207-3befcd597c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:38:15.639361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede4310-3d4a-47e7-8207-3befcd597c6c service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:38:15.658120 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 751/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:38:17.720580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233c193-8ebc-47db-8ab1-54881459c1aa None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:17.721104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233c193-8ebc-47db-8ab1-54881459c1aa None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:17.721104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233c193-8ebc-47db-8ab1-54881459c1aa None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:17.722467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 734/1485] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:38:17.728260 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c4aa6-211f-45ba-85a0-56627bf07a2f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:17.728716 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c4aa6-211f-45ba-85a0-56627bf07a2f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:17.728822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c4aa6-211f-45ba-85a0-56627bf07a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:17.796651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-fd9c4aa6-211f-45ba-85a0-56627bf07a2f None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:38:17.797845 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fd9c4aa6-211f-45ba-85a0-56627bf07a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:17.897014 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 752/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:38:17.936242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233c193-8ebc-47db-8ab1-54881459c1aa None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:38:17.937784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-0233c193-8ebc-47db-8ab1-54881459c1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:18.043580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233c193-8ebc-47db-8ab1-54881459c1aa None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:38:18.114561 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:18.116327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8688b-85cd-4598-b04a-7ca374e1e306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:38:18.116947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8688b-85cd-4598-b04a-7ca374e1e306 service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:18.117228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8688b-85cd-4598-b04a-7ca374e1e306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:18.117509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8688b-85cd-4598-b04a-7ca374e1e306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:18.119143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-f2b8688b-85cd-4598-b04a-7ca374e1e306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:18.227054 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8688b-85cd-4598-b04a-7ca374e1e306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:38:18.228566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8688b-85cd-4598-b04a-7ca374e1e306 service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:38:18.246985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 735/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:38:20.365483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a024a27-347f-4d08-b58b-2904918b2ecd None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:20.366057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a024a27-347f-4d08-b58b-2904918b2ecd None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:20.366057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a024a27-347f-4d08-b58b-2904918b2ecd None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:20.367398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 753/1488] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:38:20.372619 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382087f4-aea4-4292-8951-914ff779b5d8 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:20.373026 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382087f4-aea4-4292-8951-914ff779b5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:20.373160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382087f4-aea4-4292-8951-914ff779b5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:20.439105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-382087f4-aea4-4292-8951-914ff779b5d8 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:38:20.440342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-382087f4-aea4-4292-8951-914ff779b5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:20.492286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:20.534995 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 736/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:38:20.577191 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a024a27-347f-4d08-b58b-2904918b2ecd None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:38:20.578751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6a024a27-347f-4d08-b58b-2904918b2ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:20.615851 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:20.685959 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a024a27-347f-4d08-b58b-2904918b2ecd None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:38:20.759259 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19b27c-8e98-48d2-b706-e6d5f44cc6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:38:20.759905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19b27c-8e98-48d2-b706-e6d5f44cc6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:20.760192 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19b27c-8e98-48d2-b706-e6d5f44cc6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:20.760463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19b27c-8e98-48d2-b706-e6d5f44cc6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:20.762067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-eb19b27c-8e98-48d2-b706-e6d5f44cc6f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:20.840432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:20.870201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19b27c-8e98-48d2-b706-e6d5f44cc6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:38:20.871666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19b27c-8e98-48d2-b706-e6d5f44cc6f9 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:38:20.890067 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 754/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:38:23.306597 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bd2a7-bb91-4d96-bf6e-d3228fc676b8 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:23.307162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bd2a7-bb91-4d96-bf6e-d3228fc676b8 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:23.307162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bd2a7-bb91-4d96-bf6e-d3228fc676b8 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:23.308581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 737/1491] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 25 21:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:38:23.313802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac24a8-570f-4793-bbcf-01425cc664c9 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:23.314216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac24a8-570f-4793-bbcf-01425cc664c9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:23.314342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac24a8-570f-4793-bbcf-01425cc664c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:23.379536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a2ac24a8-570f-4793-bbcf-01425cc664c9 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:38:23.380772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a2ac24a8-570f-4793-bbcf-01425cc664c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:23.478138 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 755/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 25 21:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:38:23.516342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bd2a7-bb91-4d96-bf6e-d3228fc676b8 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:38:23.517983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-2f9bd2a7-bb91-4d96-bf6e-d3228fc676b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:23.623424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bd2a7-bb91-4d96-bf6e-d3228fc676b8 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:38:23.697275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb20fff-365a-45f4-ba3a-ecdb6cc517cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:38:23.697897 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb20fff-365a-45f4-ba3a-ecdb6cc517cd service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:38:23.698175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb20fff-365a-45f4-ba3a-ecdb6cc517cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:38:23.698445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb20fff-365a-45f4-ba3a-ecdb6cc517cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:38:23.700095 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-3eb20fff-365a-45f4-ba3a-ecdb6cc517cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:38:23.710000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:23.810247 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb20fff-365a-45f4-ba3a-ecdb6cc517cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:38:23.811666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb20fff-365a-45f4-ba3a-ecdb6cc517cd service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:38:23.832300 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 738/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:38:33.477033 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=82 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:38:33.829729 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=50 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:00.940018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d667a8-7371-4b01-9414-a78f89978cb3 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:00.940610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d667a8-7371-4b01-9414-a78f89978cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:00.940610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d667a8-7371-4b01-9414-a78f89978cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:01.016726 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-42d667a8-7371-4b01-9414-a78f89978cb3 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:40:01.017923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-42d667a8-7371-4b01-9414-a78f89978cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:01.115874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 756/1494] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:40:01.123924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2c762-782a-42a2-8378-7441af7a2a66 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:01.124418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2c762-782a-42a2-8378-7441af7a2a66 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:01.124517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2c762-782a-42a2-8378-7441af7a2a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:01.201153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-f1a2c762-782a-42a2-8378-7441af7a2a66 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:40:01.202357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-f1a2c762-782a-42a2-8378-7441af7a2a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:01.296132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 739/1495] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:40:01.300904 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d667a8-7371-4b01-9414-a78f89978cb3 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:01.302102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-42d667a8-7371-4b01-9414-a78f89978cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:01.313691 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d667a8-7371-4b01-9414-a78f89978cb3 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:01.374265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:01.408177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11c761-a959-4ce0-9d88-dfdadb75e3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:01.408826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11c761-a959-4ce0-9d88-dfdadb75e3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:01.409104 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11c761-a959-4ce0-9d88-dfdadb75e3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:01.409377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11c761-a959-4ce0-9d88-dfdadb75e3d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:01.410063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11c761-a959-4ce0-9d88-dfdadb75e3d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:40:01.410367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11c761-a959-4ce0-9d88-dfdadb75e3d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:01.411382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: WARNING py.warnings [None req-9f11c761-a959-4ce0-9d88-dfdadb75e3d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:40:01.411382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: warnings.warn(msg) Jul 25 21:40:01.411382 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: Jul 25 21:40:01.412448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11c761-a959-4ce0-9d88-dfdadb75e3d8 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:01.424964 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 757/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Jul 25 21:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:40:01.433664 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2c762-782a-42a2-8378-7441af7a2a66 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:01.442752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2c762-782a-42a2-8378-7441af7a2a66 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:01.504577 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:01.539015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f1da2-a32e-413b-a3ec-7dc20df5fd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:01.539955 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f1da2-a32e-413b-a3ec-7dc20df5fd7c admin admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:01.540235 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f1da2-a32e-413b-a3ec-7dc20df5fd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:01.540501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f1da2-a32e-413b-a3ec-7dc20df5fd7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:01.541167 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f1da2-a32e-413b-a3ec-7dc20df5fd7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:01.542928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: WARNING py.warnings [None req-642f1da2-a32e-413b-a3ec-7dc20df5fd7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:40:01.542928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: warnings.warn(msg) Jul 25 21:40:01.542928 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: Jul 25 21:40:01.544128 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f1da2-a32e-413b-a3ec-7dc20df5fd7c admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:01.683367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 740/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Jul 25 21:40:01 2022] POST /identity/v3/projects => generated 379 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:40:01.687421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11c761-a959-4ce0-9d88-dfdadb75e3d8 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:01.689041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9f11c761-a959-4ce0-9d88-dfdadb75e3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:01.723068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11c761-a959-4ce0-9d88-dfdadb75e3d8 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:01.817378 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bce784-7a5e-4dfc-82e3-5f9baa8b8536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:01.818670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bce784-7a5e-4dfc-82e3-5f9baa8b8536 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:01.818831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bce784-7a5e-4dfc-82e3-5f9baa8b8536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:01.819111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bce784-7a5e-4dfc-82e3-5f9baa8b8536 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:01.819816 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bce784-7a5e-4dfc-82e3-5f9baa8b8536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:01.820837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: WARNING py.warnings [None req-34bce784-7a5e-4dfc-82e3-5f9baa8b8536 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:40:01.820837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: warnings.warn(msg) Jul 25 21:40:01.820837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: Jul 25 21:40:01.822043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bce784-7a5e-4dfc-82e3-5f9baa8b8536 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:01.924399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 758/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 21:40:01 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:40:01.929386 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f1da2-a32e-413b-a3ec-7dc20df5fd7c admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:01.930984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-642f1da2-a32e-413b-a3ec-7dc20df5fd7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:01.994228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f1da2-a32e-413b-a3ec-7dc20df5fd7c admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:02.079587 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:02.090008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee37f0b-ed07-4758-82ef-97ff65df9611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:02.093071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee37f0b-ed07-4758-82ef-97ff65df9611 admin admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:02.093071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee37f0b-ed07-4758-82ef-97ff65df9611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:02.093071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee37f0b-ed07-4758-82ef-97ff65df9611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:02.093071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee37f0b-ed07-4758-82ef-97ff65df9611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:02.093071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: WARNING py.warnings [None req-4ee37f0b-ed07-4758-82ef-97ff65df9611 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:40:02.093071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: warnings.warn(msg) Jul 25 21:40:02.093071 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: Jul 25 21:40:02.093717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee37f0b-ed07-4758-82ef-97ff65df9611 admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:02.106555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 741/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Jul 25 21:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:40:02.110677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bce784-7a5e-4dfc-82e3-5f9baa8b8536 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:02.112217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-34bce784-7a5e-4dfc-82e3-5f9baa8b8536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:02.124379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bce784-7a5e-4dfc-82e3-5f9baa8b8536 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:02.149441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:02.222165 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6072e8d-c947-4c23-8829-3db4179010bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:02.223234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6072e8d-c947-4c23-8829-3db4179010bc admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:02.223767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6072e8d-c947-4c23-8829-3db4179010bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:02.224827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6072e8d-c947-4c23-8829-3db4179010bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:02.226002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6072e8d-c947-4c23-8829-3db4179010bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:02.227032 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: WARNING py.warnings [None req-c6072e8d-c947-4c23-8829-3db4179010bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:40:02.227032 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: warnings.warn(msg) Jul 25 21:40:02.227032 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: Jul 25 21:40:02.228017 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6072e8d-c947-4c23-8829-3db4179010bc admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:02.242776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 759/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Jul 25 21:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:40:02.247083 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee37f0b-ed07-4758-82ef-97ff65df9611 admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:02.248584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-4ee37f0b-ed07-4758-82ef-97ff65df9611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:02.281636 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee37f0b-ed07-4758-82ef-97ff65df9611 admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:02.378000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1f064-3982-4e2c-88b2-bf1cc04fcae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:02.378668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1f064-3982-4e2c-88b2-bf1cc04fcae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:02.378953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1f064-3982-4e2c-88b2-bf1cc04fcae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:02.379224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1f064-3982-4e2c-88b2-bf1cc04fcae1 admin admin] PATH_INFO: `/v3/projects/ba029efbafc34ef2a8baf72c58b0e854/users/05ba6fb25e734508878332fcffd7489b/roles/59d226afaffe45f597d70faf647f2f22` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:02.401831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1f064-3982-4e2c-88b2-bf1cc04fcae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba029efbafc34ef2a8baf72c58b0e854, user_id=05ba6fb25e734508878332fcffd7489b, role_id=59d226afaffe45f597d70faf647f2f22)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:02.402843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: WARNING py.warnings [None req-9fa1f064-3982-4e2c-88b2-bf1cc04fcae1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:40:02.402843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: warnings.warn(msg) Jul 25 21:40:02.402843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: Jul 25 21:40:02.404791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1f064-3982-4e2c-88b2-bf1cc04fcae1 admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:02.495758 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 742/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Jul 25 21:40:02 2022] PUT /identity/v3/projects/ba029efbafc34ef2a8baf72c58b0e854/users/05ba6fb25e734508878332fcffd7489b/roles/59d226afaffe45f597d70faf647f2f22 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:40:02.508021 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3d9c6-74e6-41f6-978b-7bc7224ddfe6 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:02.508311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3d9c6-74e6-41f6-978b-7bc7224ddfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:02.508618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3d9c6-74e6-41f6-978b-7bc7224ddfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:02.567181 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-fce3d9c6-74e6-41f6-978b-7bc7224ddfe6 None None] MFA Rules not processed for user `05ba6fb25e734508878332fcffd7489b`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:40:02.568997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-fce3d9c6-74e6-41f6-978b-7bc7224ddfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:02.648696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 760/1502] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:40:02.661793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016dfdc-6e43-41a8-b39b-32638eaef7e7 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:02.662118 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016dfdc-6e43-41a8-b39b-32638eaef7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:02.662430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016dfdc-6e43-41a8-b39b-32638eaef7e7 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:02.663789 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 743/1503] 10.222.0.27 () {54 vars in 964 bytes} [Mon Jul 25 21:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:40:02.668519 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be284b2-08cc-4bf0-a960-f240faabfff9 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:02.668811 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be284b2-08cc-4bf0-a960-f240faabfff9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:02.669091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be284b2-08cc-4bf0-a960-f240faabfff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:02.700304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:02.744369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-7be284b2-08cc-4bf0-a960-f240faabfff9 None None] MFA Rules not processed for user `8ed104145f1f4a3aa76659ae6ceac4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:40:02.745568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-7be284b2-08cc-4bf0-a960-f240faabfff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:02.821332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 761/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Mon Jul 25 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:40:02.828952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016dfdc-6e43-41a8-b39b-32638eaef7e7 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:02.830464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-0016dfdc-6e43-41a8-b39b-32638eaef7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:02.885694 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:02.940331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016dfdc-6e43-41a8-b39b-32638eaef7e7 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:03.015208 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e42d1a-05bd-4827-b1f2-63facd75b057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed104145f1f4a3aa76659ae6ceac4ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:03.015859 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e42d1a-05bd-4827-b1f2-63facd75b057 service cinder] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:03.016143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e42d1a-05bd-4827-b1f2-63facd75b057 service cinder] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:03.016417 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e42d1a-05bd-4827-b1f2-63facd75b057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:03.018045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-59e42d1a-05bd-4827-b1f2-63facd75b057 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:03.116273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e42d1a-05bd-4827-b1f2-63facd75b057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:03.117620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e42d1a-05bd-4827-b1f2-63facd75b057 service cinder] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:03.121107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:03.135111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 744/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:40:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:40:03.181944 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11619b-277d-4e68-9ad5-6b82334d8b78 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:03.182379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11619b-277d-4e68-9ad5-6b82334d8b78 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:03.182495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11619b-277d-4e68-9ad5-6b82334d8b78 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:03.183825 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 762/1506] 10.222.0.27 () {52 vars in 830 bytes} [Mon Jul 25 21:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:40:03.187334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e42d1a-05bd-4827-b1f2-63facd75b057 service cinder] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:03.188610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-59e42d1a-05bd-4827-b1f2-63facd75b057 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:03.288554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e42d1a-05bd-4827-b1f2-63facd75b057 service cinder] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:03.382661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:03.383234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:03.383555 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:03.383861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] PATH_INFO: `/v3/users/05ba6fb25e734508878332fcffd7489b` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:03.396779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ba6fb25e734508878332fcffd7489b)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:03.397832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: WARNING py.warnings [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:40:03.397832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: warnings.warn(msg) Jul 25 21:40:03.397832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: Jul 25 21:40:03.399090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:03.408703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:03.632087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ba6fb25e734508878332fcffd7489b'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:03.704405 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ba6fb25e734508878332fcffd7489b'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:03.704877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ba6fb25e734508878332fcffd7489b'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:03.724196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ba6fb25e734508878332fcffd7489b'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:03.736412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ba6fb25e734508878332fcffd7489b'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:03.742696 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 745/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Jul 25 21:40:03 2022] DELETE /identity/v3/users/05ba6fb25e734508878332fcffd7489b => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:40:03.747213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fb11c-ad6e-49f1-92e0-cf89401e73e3 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:03.747509 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fb11c-ad6e-49f1-92e0-cf89401e73e3 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:03.747818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fb11c-ad6e-49f1-92e0-cf89401e73e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:03.807330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c53fb11c-ad6e-49f1-92e0-cf89401e73e3 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:40:03.808559 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c53fb11c-ad6e-49f1-92e0-cf89401e73e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:03.884956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:03.898079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 763/1508] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:40:03.907757 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:03.909025 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:04.010546 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed9edf-4898-4059-ac1a-bad37c5ccc8b admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:04.064520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:04.084482 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9645a66-95dc-4981-9e21-fd0db5e248d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:04.085096 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9645a66-95dc-4981-9e21-fd0db5e248d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:04.085375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9645a66-95dc-4981-9e21-fd0db5e248d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:04.085671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9645a66-95dc-4981-9e21-fd0db5e248d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:04.087348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-a9645a66-95dc-4981-9e21-fd0db5e248d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:04.195272 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9645a66-95dc-4981-9e21-fd0db5e248d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:04.196740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9645a66-95dc-4981-9e21-fd0db5e248d0 service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:04.217432 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 746/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:40:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:40:04.832593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fb11c-ad6e-49f1-92e0-cf89401e73e3 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:40:04.835043 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c53fb11c-ad6e-49f1-92e0-cf89401e73e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:40:04.846447 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fb11c-ad6e-49f1-92e0-cf89401e73e3 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:40:04.949377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71d3d6-13d8-401a-9054-a2c62175e2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:40:04.950028 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71d3d6-13d8-401a-9054-a2c62175e2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:40:04.950309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71d3d6-13d8-401a-9054-a2c62175e2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:40:04.950583 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71d3d6-13d8-401a-9054-a2c62175e2c2 admin admin] PATH_INFO: `/v3/projects/ba029efbafc34ef2a8baf72c58b0e854` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:40:04.961465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71d3d6-13d8-401a-9054-a2c62175e2c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba029efbafc34ef2a8baf72c58b0e854)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:40:04.962511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: WARNING py.warnings [None req-fd71d3d6-13d8-401a-9054-a2c62175e2c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:40:04.962511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: warnings.warn(msg) Jul 25 21:40:04.962511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: Jul 25 21:40:04.963718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71d3d6-13d8-401a-9054-a2c62175e2c2 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:40:05.089693 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-fd71d3d6-13d8-401a-9054-a2c62175e2c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba029efbafc34ef2a8baf72c58b0e854', 'request_id': 'req-fd71d3d6-13d8-401a-9054-a2c62175e2c2'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:05.186554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-fd71d3d6-13d8-401a-9054-a2c62175e2c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba029efbafc34ef2a8baf72c58b0e854', 'request_id': 'req-fd71d3d6-13d8-401a-9054-a2c62175e2c2'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:05.193946 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-fd71d3d6-13d8-401a-9054-a2c62175e2c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba029efbafc34ef2a8baf72c58b0e854', 'request_id': 'req-fd71d3d6-13d8-401a-9054-a2c62175e2c2'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:05.224786 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-fd71d3d6-13d8-401a-9054-a2c62175e2c2 admin admin] The token cache is being invalidate because project ba029efbafc34ef2a8baf72c58b0e854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 21:40:05.224786 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-fd71d3d6-13d8-401a-9054-a2c62175e2c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:05.225239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-fd71d3d6-13d8-401a-9054-a2c62175e2c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:40:05.226686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 764/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Jul 25 21:40:04 2022] DELETE /identity/v3/projects/ba029efbafc34ef2a8baf72c58b0e854 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:40:14.215114 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=62 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:40:15.222374 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:41:25.370668 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b4f78-3047-4ccf-8f3e-ab9e4cc7ea3f None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:25.371243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b4f78-3047-4ccf-8f3e-ab9e4cc7ea3f None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:25.371243 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b4f78-3047-4ccf-8f3e-ab9e4cc7ea3f None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:25.372574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:41:25.377373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26c277-566f-4771-b674-b45b30eef325 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:25.377826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26c277-566f-4771-b674-b45b30eef325 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:25.377930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26c277-566f-4771-b674-b45b30eef325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:25.459475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-af26c277-566f-4771-b674-b45b30eef325 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:41:25.460730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-af26c277-566f-4771-b674-b45b30eef325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:25.563531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:41:25.720766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b4f78-3047-4ccf-8f3e-ab9e4cc7ea3f None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:41:25.722877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-097b4f78-3047-4ccf-8f3e-ab9e4cc7ea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:25.841406 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b4f78-3047-4ccf-8f3e-ab9e4cc7ea3f None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:41:25.846756 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f9a0d-a7e5-4057-9da2-b86bb042a307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:41:25.847393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f9a0d-a7e5-4057-9da2-b86bb042a307 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:25.847677 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f9a0d-a7e5-4057-9da2-b86bb042a307 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:25.847984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f9a0d-a7e5-4057-9da2-b86bb042a307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:25.856105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f9a0d-a7e5-4057-9da2-b86bb042a307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:41:25.857685 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f9a0d-a7e5-4057-9da2-b86bb042a307 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:41:25.867080 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 748/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:41:26.703814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2917881-b52b-4f38-93c3-0c624659c784 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:26.704304 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2917881-b52b-4f38-93c3-0c624659c784 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:26.704409 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2917881-b52b-4f38-93c3-0c624659c784 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:26.705744 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:41:26.710485 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636ceaf-beba-410b-a2df-bf2c11a699a3 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:26.710900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636ceaf-beba-410b-a2df-bf2c11a699a3 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:26.711042 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636ceaf-beba-410b-a2df-bf2c11a699a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:26.730540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-4636ceaf-beba-410b-a2df-bf2c11a699a3 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:41:26.731728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-4636ceaf-beba-410b-a2df-bf2c11a699a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:26.739442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:41:26.893645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2917881-b52b-4f38-93c3-0c624659c784 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:41:26.908424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2917881-b52b-4f38-93c3-0c624659c784 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:41:26.913886 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c9ffe-9c6e-4b8a-8569-63903ae05050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:41:26.914484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c9ffe-9c6e-4b8a-8569-63903ae05050 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:26.914764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c9ffe-9c6e-4b8a-8569-63903ae05050 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:26.915036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c9ffe-9c6e-4b8a-8569-63903ae05050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:26.924361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c9ffe-9c6e-4b8a-8569-63903ae05050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:41:26.925932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c9ffe-9c6e-4b8a-8569-63903ae05050 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:41:26.935814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 767/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:41:30.295305 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aab826-d14f-41f3-b692-018e9a235856 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:30.296148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aab826-d14f-41f3-b692-018e9a235856 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:30.296148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aab826-d14f-41f3-b692-018e9a235856 None None] PATH_INFO: `/v3` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:30.297405 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 750/1517] 10.222.0.49 () {54 vars in 925 bytes} [Mon Jul 25 21:41:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 21:41:30.324282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637209c-e58c-4a74-abd1-31eb44ebf2cf None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:30.324773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637209c-e58c-4a74-abd1-31eb44ebf2cf None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:30.324881 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637209c-e58c-4a74-abd1-31eb44ebf2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:30.388422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6637209c-e58c-4a74-abd1-31eb44ebf2cf None None] MFA Rules not processed for user `6076b9f003c749348fcddef6f6ed28e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:41:30.389634 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6637209c-e58c-4a74-abd1-31eb44ebf2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:30.407188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:41:30.461748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 768/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Jul 25 21:41:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:41:34.558837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cca52-fea9-41ab-8362-915498a0c257 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:34.559348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cca52-fea9-41ab-8362-915498a0c257 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:34.559348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cca52-fea9-41ab-8362-915498a0c257 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:34.560657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 751/1519] 10.222.0.27 () {54 vars in 961 bytes} [Mon Jul 25 21:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:41:34.565559 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39391c-675f-4d68-95ae-5a03f694ae9e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:34.566008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39391c-675f-4d68-95ae-5a03f694ae9e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:34.566155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39391c-675f-4d68-95ae-5a03f694ae9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:34.586257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-6a39391c-675f-4d68-95ae-5a03f694ae9e None None] MFA Rules not processed for user `6076b9f003c749348fcddef6f6ed28e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:41:34.587578 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-6a39391c-675f-4d68-95ae-5a03f694ae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:34.596127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 769/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Jul 25 21:41:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:41:34.603580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cca52-fea9-41ab-8362-915498a0c257 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:41:34.617064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cca52-fea9-41ab-8362-915498a0c257 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:41:34.622646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72dd30b-3c59-435e-a257-9e6a79f1e048 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6076b9f003c749348fcddef6f6ed28e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:41:34.623246 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dd30b-3c59-435e-a257-9e6a79f1e048 service placement] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:34.623530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dd30b-3c59-435e-a257-9e6a79f1e048 service placement] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:34.623833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dd30b-3c59-435e-a257-9e6a79f1e048 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:34.632023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72dd30b-3c59-435e-a257-9e6a79f1e048 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:41:34.633596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72dd30b-3c59-435e-a257-9e6a79f1e048 service placement] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:41:34.643841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 752/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:41:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:41:38.162873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdb735-416b-4aeb-a9d3-9eb2abd3770a None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:38.163443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdb735-416b-4aeb-a9d3-9eb2abd3770a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:38.163443 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdb735-416b-4aeb-a9d3-9eb2abd3770a None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:38.164876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:41:38.169675 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99437f2-74dd-47cc-b7ee-15d5dae741e0 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:38.170088 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99437f2-74dd-47cc-b7ee-15d5dae741e0 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:38.170238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99437f2-74dd-47cc-b7ee-15d5dae741e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:38.190171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-a99437f2-74dd-47cc-b7ee-15d5dae741e0 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:41:38.191371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-a99437f2-74dd-47cc-b7ee-15d5dae741e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:38.200121 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:41:38.360090 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdb735-416b-4aeb-a9d3-9eb2abd3770a None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:41:38.372790 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdb735-416b-4aeb-a9d3-9eb2abd3770a None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:41:38.378234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc47c2-3127-4076-92ca-6d460031ccfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:41:38.378842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc47c2-3127-4076-92ca-6d460031ccfc service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:38.383056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc47c2-3127-4076-92ca-6d460031ccfc service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:38.383056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc47c2-3127-4076-92ca-6d460031ccfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:38.388135 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc47c2-3127-4076-92ca-6d460031ccfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:41:38.389737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc47c2-3127-4076-92ca-6d460031ccfc service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:41:38.399450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 771/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:41:39.242556 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b23b-226f-4f1c-aa8b-0633122fe48b None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:39.243137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b23b-226f-4f1c-aa8b-0633122fe48b None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:39.243137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2b23b-226f-4f1c-aa8b-0633122fe48b None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:39.245082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 21:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:41:39.250031 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1375f77-3adb-47b0-99c4-6c24514e0a4a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:39.250464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1375f77-3adb-47b0-99c4-6c24514e0a4a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:39.250588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1375f77-3adb-47b0-99c4-6c24514e0a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:39.269873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-b1375f77-3adb-47b0-99c4-6c24514e0a4a None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:41:39.271113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-b1375f77-3adb-47b0-99c4-6c24514e0a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:39.279228 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 21:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:41:39.434749 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b23b-226f-4f1c-aa8b-0633122fe48b None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:41:39.449591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2b23b-226f-4f1c-aa8b-0633122fe48b None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:41:39.455069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c4d1e-4d13-47d3-b6c4-b8e0c128806c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:41:39.455670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c4d1e-4d13-47d3-b6c4-b8e0c128806c service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:39.455974 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c4d1e-4d13-47d3-b6c4-b8e0c128806c service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:39.456251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c4d1e-4d13-47d3-b6c4-b8e0c128806c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:39.464436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c4d1e-4d13-47d3-b6c4-b8e0c128806c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:41:39.465993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c4d1e-4d13-47d3-b6c4-b8e0c128806c service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:41:39.475118 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 755/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:41:43.437767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213857c1-61d7-4231-adc7-c1d11197d9e9 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:43.438284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213857c1-61d7-4231-adc7-c1d11197d9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:43.438284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213857c1-61d7-4231-adc7-c1d11197d9e9 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:43.439641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:41:43.444692 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd27f6a-cb0c-460d-97af-12452048228e None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:43.445158 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd27f6a-cb0c-460d-97af-12452048228e None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:43.445268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd27f6a-cb0c-460d-97af-12452048228e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:43.464715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-1cd27f6a-cb0c-460d-97af-12452048228e None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:41:43.465929 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-1cd27f6a-cb0c-460d-97af-12452048228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:43.473798 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:41:43.549895 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213857c1-61d7-4231-adc7-c1d11197d9e9 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:41:43.551600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-213857c1-61d7-4231-adc7-c1d11197d9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:43.632986 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213857c1-61d7-4231-adc7-c1d11197d9e9 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:41:43.638373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58677231-511b-4108-bbcf-cc3be2e7ff3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:41:43.638373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58677231-511b-4108-bbcf-cc3be2e7ff3e service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:43.638373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58677231-511b-4108-bbcf-cc3be2e7ff3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:43.638679 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58677231-511b-4108-bbcf-cc3be2e7ff3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:43.647630 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58677231-511b-4108-bbcf-cc3be2e7ff3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:41:43.649082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58677231-511b-4108-bbcf-cc3be2e7ff3e service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:41:43.660267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 774/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:41:45.675876 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e2fc9-be25-4f12-a823-b5423ec81d61 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:45.676655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e2fc9-be25-4f12-a823-b5423ec81d61 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:45.676655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e2fc9-be25-4f12-a823-b5423ec81d61 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:45.677778 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:41:45.683532 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4138dc-86f7-4588-bc61-2f043e5e98fe None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:45.684094 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4138dc-86f7-4588-bc61-2f043e5e98fe None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:45.684231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4138dc-86f7-4588-bc61-2f043e5e98fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:45.705284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-aa4138dc-86f7-4588-bc61-2f043e5e98fe None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:41:45.706416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-aa4138dc-86f7-4588-bc61-2f043e5e98fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:45.715410 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:41:45.751616 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e2fc9-be25-4f12-a823-b5423ec81d61 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:41:45.762314 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e2fc9-be25-4f12-a823-b5423ec81d61 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:41:45.765827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726b017-72b9-443f-8252-da4c75370753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:41:45.766428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726b017-72b9-443f-8252-da4c75370753 service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:45.766709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726b017-72b9-443f-8252-da4c75370753 service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:45.766982 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726b017-72b9-443f-8252-da4c75370753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:45.776536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726b017-72b9-443f-8252-da4c75370753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:41:45.777956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726b017-72b9-443f-8252-da4c75370753 service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:41:45.787231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 758/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:41:49.333618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418395a5-e555-4314-b709-fe0c0adf83fc None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:49.334158 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418395a5-e555-4314-b709-fe0c0adf83fc None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:49.334158 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418395a5-e555-4314-b709-fe0c0adf83fc None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:49.335462 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:41:49.341427 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d4ff-a1cb-4694-95dc-e353c9eb7aff None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:49.341884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d4ff-a1cb-4694-95dc-e353c9eb7aff None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:49.342005 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d4ff-a1cb-4694-95dc-e353c9eb7aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:49.361094 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-5206d4ff-a1cb-4694-95dc-e353c9eb7aff None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:41:49.362294 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-5206d4ff-a1cb-4694-95dc-e353c9eb7aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:49.370942 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:41:49.678387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418395a5-e555-4314-b709-fe0c0adf83fc None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:41:49.680113 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-418395a5-e555-4314-b709-fe0c0adf83fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:49.748000 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:41:49.761016 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418395a5-e555-4314-b709-fe0c0adf83fc None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:41:49.764650 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd4d91-d371-42fd-89ca-1877853a1bf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed104145f1f4a3aa76659ae6ceac4ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:41:49.765268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd4d91-d371-42fd-89ca-1877853a1bf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:49.765549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd4d91-d371-42fd-89ca-1877853a1bf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:49.765824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd4d91-d371-42fd-89ca-1877853a1bf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:49.774931 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd4d91-d371-42fd-89ca-1877853a1bf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:41:49.776905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd4d91-d371-42fd-89ca-1877853a1bf9 service cinder] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:41:49.786465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 777/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:41:51.815369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40639e25-4cc1-4a8c-b066-c7d6ffd1c5dd None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:51.816132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40639e25-4cc1-4a8c-b066-c7d6ffd1c5dd None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:51.816132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40639e25-4cc1-4a8c-b066-c7d6ffd1c5dd None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:51.817329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 21:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:41:51.823448 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb1467-f4a0-4edb-9d18-1aa4dfaa3395 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:51.823923 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb1467-f4a0-4edb-9d18-1aa4dfaa3395 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:51.824036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb1467-f4a0-4edb-9d18-1aa4dfaa3395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:51.846384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8fbb1467-f4a0-4edb-9d18-1aa4dfaa3395 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:41:51.847633 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8fbb1467-f4a0-4edb-9d18-1aa4dfaa3395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:51.856549 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 21:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:41:52.159116 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40639e25-4cc1-4a8c-b066-c7d6ffd1c5dd None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:41:52.160809 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-40639e25-4cc1-4a8c-b066-c7d6ffd1c5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:41:52.174036 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40639e25-4cc1-4a8c-b066-c7d6ffd1c5dd None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:41:52.177582 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457754a9-4abe-43d6-8bcb-b34c3ba732c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed104145f1f4a3aa76659ae6ceac4ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:41:52.178214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457754a9-4abe-43d6-8bcb-b34c3ba732c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:41:52.178495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457754a9-4abe-43d6-8bcb-b34c3ba732c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:41:52.178771 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457754a9-4abe-43d6-8bcb-b34c3ba732c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:41:52.187810 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457754a9-4abe-43d6-8bcb-b34c3ba732c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:41:52.189221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457754a9-4abe-43d6-8bcb-b34c3ba732c2 service cinder] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:41:52.199171 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 761/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:42:01.840068 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=11 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:42:02.194345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=89 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:17.008946 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3905b-8a78-4f58-90e9-ef2b61b57083 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.009541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3905b-8a78-4f58-90e9-ef2b61b57083 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.009541 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3905b-8a78-4f58-90e9-ef2b61b57083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.029476 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-c0d3905b-8a78-4f58-90e9-ef2b61b57083 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:17.030681 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c0d3905b-8a78-4f58-90e9-ef2b61b57083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:17.038544 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 779/1540] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:43:17.047766 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a47fd3-b9c4-43e1-a302-e6744928b30d None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.048515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a47fd3-b9c4-43e1-a302-e6744928b30d None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.048515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a47fd3-b9c4-43e1-a302-e6744928b30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.063137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffdde4-5024-4d37-864c-e71bd5d5ed66 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.063419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffdde4-5024-4d37-864c-e71bd5d5ed66 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.063700 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffdde4-5024-4d37-864c-e71bd5d5ed66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.067523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-e9a47fd3-b9c4-43e1-a302-e6744928b30d None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:17.068753 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-e9a47fd3-b9c4-43e1-a302-e6744928b30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:17.076823 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 762/1541] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:43:17.081390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a47fd3-b9c4-43e1-a302-e6744928b30d None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.083654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-eeffdde4-5024-4d37-864c-e71bd5d5ed66 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:17.084872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-eeffdde4-5024-4d37-864c-e71bd5d5ed66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:17.091103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a47fd3-b9c4-43e1-a302-e6744928b30d None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.093786 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 780/1542] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:43:17.095721 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa9a28-6cc1-4315-b1af-2d61e7bc265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.096364 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa9a28-6cc1-4315-b1af-2d61e7bc265c admin admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.096656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa9a28-6cc1-4315-b1af-2d61e7bc265c admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.096934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa9a28-6cc1-4315-b1af-2d61e7bc265c admin admin] PATH_INFO: `/v3/domains` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.097632 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa9a28-6cc1-4315-b1af-2d61e7bc265c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80308) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:17.097939 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa9a28-6cc1-4315-b1af-2d61e7bc265c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.098954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: WARNING py.warnings [None req-96aa9a28-6cc1-4315-b1af-2d61e7bc265c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:43:17.098954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: warnings.warn(msg) Jul 25 21:43:17.098954 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: Jul 25 21:43:17.099863 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa9a28-6cc1-4315-b1af-2d61e7bc265c admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.102466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadf810-4f4f-4dc1-8144-7ae10e1721ba None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.102747 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadf810-4f4f-4dc1-8144-7ae10e1721ba None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.103018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadf810-4f4f-4dc1-8144-7ae10e1721ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.119866 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 763/1543] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Jul 25 21:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:17.120839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa9a28-6cc1-4315-b1af-2d61e7bc265c admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.122682 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-efadf810-4f4f-4dc1-8144-7ae10e1721ba None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:17.123907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-efadf810-4f4f-4dc1-8144-7ae10e1721ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:17.130605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa9a28-6cc1-4315-b1af-2d61e7bc265c admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.131909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 781/1544] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:43:17.135428 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7ea8c-d947-4833-b419-c75a4317230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.136084 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7ea8c-d947-4833-b419-c75a4317230a admin admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.136366 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7ea8c-d947-4833-b419-c75a4317230a admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.136614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadf810-4f4f-4dc1-8144-7ae10e1721ba None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.136730 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7ea8c-d947-4833-b419-c75a4317230a admin admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.137301 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7ea8c-d947-4833-b419-c75a4317230a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.139186 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7ea8c-d947-4833-b419-c75a4317230a admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.145527 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadf810-4f4f-4dc1-8144-7ae10e1721ba None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.150961 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bb22e-59a7-42bf-802d-0f040abec5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.151566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb22e-59a7-42bf-802d-0f040abec5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.151873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb22e-59a7-42bf-802d-0f040abec5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.152154 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb22e-59a7-42bf-802d-0f040abec5b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.152847 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bb22e-59a7-42bf-802d-0f040abec5b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 21:43:17.153155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bb22e-59a7-42bf-802d-0f040abec5b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.154737 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bb22e-59a7-42bf-802d-0f040abec5b8 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.172890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 782/1545] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Jul 25 21:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 21:43:17.175713 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bb22e-59a7-42bf-802d-0f040abec5b8 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.185567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bb22e-59a7-42bf-802d-0f040abec5b8 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.190276 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b14595-34ea-4f79-9b36-b194873a879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.190869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b14595-34ea-4f79-9b36-b194873a879a admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.191173 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b14595-34ea-4f79-9b36-b194873a879a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.191431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b14595-34ea-4f79-9b36-b194873a879a admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.192132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b14595-34ea-4f79-9b36-b194873a879a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.193145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: WARNING py.warnings [None req-22b14595-34ea-4f79-9b36-b194873a879a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:43:17.193145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: warnings.warn(msg) Jul 25 21:43:17.193145 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: Jul 25 21:43:17.194356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b14595-34ea-4f79-9b36-b194873a879a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.222400 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 764/1546] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Jul 25 21:43:17 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:43:17.227305 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7ea8c-d947-4833-b419-c75a4317230a admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.277060 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 783/1547] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Jul 25 21:43:17 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:43:17.278153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b14595-34ea-4f79-9b36-b194873a879a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.288740 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7ea8c-d947-4833-b419-c75a4317230a admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.345985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b14595-34ea-4f79-9b36-b194873a879a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.346248 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dfbcb-eb14-4752-a9d8-b91ea0b0f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.346883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dfbcb-eb14-4752-a9d8-b91ea0b0f66f admin admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.347162 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dfbcb-eb14-4752-a9d8-b91ea0b0f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.347433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dfbcb-eb14-4752-a9d8-b91ea0b0f66f admin admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.348134 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2dfbcb-eb14-4752-a9d8-b91ea0b0f66f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.349144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: WARNING py.warnings [None req-0c2dfbcb-eb14-4752-a9d8-b91ea0b0f66f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:43:17.349144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: warnings.warn(msg) Jul 25 21:43:17.349144 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: Jul 25 21:43:17.350336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2dfbcb-eb14-4752-a9d8-b91ea0b0f66f admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.350797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d870c9-cba9-43eb-a6cb-f21a98b8c16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.352038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d870c9-cba9-43eb-a6cb-f21a98b8c16c admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.352325 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d870c9-cba9-43eb-a6cb-f21a98b8c16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.352718 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d870c9-cba9-43eb-a6cb-f21a98b8c16c admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.353399 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d870c9-cba9-43eb-a6cb-f21a98b8c16c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.355318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d870c9-cba9-43eb-a6cb-f21a98b8c16c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.431785 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 765/1548] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 21:43:17 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:43:17.435658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dfbcb-eb14-4752-a9d8-b91ea0b0f66f admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.445814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dfbcb-eb14-4752-a9d8-b91ea0b0f66f admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.450580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b845b8-75ea-443c-a258-4add85f2d282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.451192 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b845b8-75ea-443c-a258-4add85f2d282 admin admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.451467 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b845b8-75ea-443c-a258-4add85f2d282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.451760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b845b8-75ea-443c-a258-4add85f2d282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.454340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b845b8-75ea-443c-a258-4add85f2d282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.454340 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b845b8-75ea-443c-a258-4add85f2d282 admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.457770 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 784/1549] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 21:43:17 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:43:17.458938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d870c9-cba9-43eb-a6cb-f21a98b8c16c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.469133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 766/1550] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Jul 25 21:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 21:43:17.469842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d870c9-cba9-43eb-a6cb-f21a98b8c16c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.470446 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b845b8-75ea-443c-a258-4add85f2d282 admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.474621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25a1f5-a2fa-4d4c-a3d5-b2717b40f4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.475224 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25a1f5-a2fa-4d4c-a3d5-b2717b40f4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.475507 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25a1f5-a2fa-4d4c-a3d5-b2717b40f4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.475805 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25a1f5-a2fa-4d4c-a3d5-b2717b40f4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.476602 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25a1f5-a2fa-4d4c-a3d5-b2717b40f4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.478326 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25a1f5-a2fa-4d4c-a3d5-b2717b40f4c5 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.481914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b845b8-75ea-443c-a258-4add85f2d282 admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.485504 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b27c9-cc1b-449a-93fa-6240933aef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.486112 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b27c9-cc1b-449a-93fa-6240933aef85 admin admin] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.486394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b27c9-cc1b-449a-93fa-6240933aef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.486715 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b27c9-cc1b-449a-93fa-6240933aef85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.487449 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b27c9-cc1b-449a-93fa-6240933aef85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.491768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 785/1551] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Jul 25 21:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:43:17.491922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b27c9-cc1b-449a-93fa-6240933aef85 admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.493258 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25a1f5-a2fa-4d4c-a3d5-b2717b40f4c5 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.502329 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 767/1552] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Jul 25 21:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 21:43:17.505990 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25a1f5-a2fa-4d4c-a3d5-b2717b40f4c5 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.508585 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b31fa-740f-44ae-8774-a269cc8a11b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.509249 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b31fa-740f-44ae-8774-a269cc8a11b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.509373 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b27c9-cc1b-449a-93fa-6240933aef85 admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.509538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b31fa-740f-44ae-8774-a269cc8a11b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.509814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b31fa-740f-44ae-8774-a269cc8a11b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.510513 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b31fa-740f-44ae-8774-a269cc8a11b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.512132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b31fa-740f-44ae-8774-a269cc8a11b4 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.519176 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b27c9-cc1b-449a-93fa-6240933aef85 admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.524861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bcf73-1897-46b5-a6ab-a56b7d481673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.525034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 786/1553] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Jul 25 21:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:43:17.525595 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bcf73-1897-46b5-a6ab-a56b7d481673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.525869 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bcf73-1897-46b5-a6ab-a56b7d481673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.526139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bcf73-1897-46b5-a6ab-a56b7d481673 admin admin] PATH_INFO: `/v3/projects/43e0650870cb41489254ce1cf893230e/users/2e2b38fe46634485acbaab1de5bb5a10/roles/59d226afaffe45f597d70faf647f2f22` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.528391 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b31fa-740f-44ae-8774-a269cc8a11b4 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.537819 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b31fa-740f-44ae-8774-a269cc8a11b4 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.542061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bcf73-1897-46b5-a6ab-a56b7d481673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e0650870cb41489254ce1cf893230e, user_id=2e2b38fe46634485acbaab1de5bb5a10, role_id=59d226afaffe45f597d70faf647f2f22)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.542893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a2bd9-ba45-48b7-9908-74d7a5d6ecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.543590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a2bd9-ba45-48b7-9908-74d7a5d6ecd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.543914 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a2bd9-ba45-48b7-9908-74d7a5d6ecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.546180 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a2bd9-ba45-48b7-9908-74d7a5d6ecd9 admin admin] PATH_INFO: `/v3/projects/b08e2704cd264b6b8096da68b310420b/users/c84a9ca55a3f40d09e9e3097e09dfa22/roles/59d226afaffe45f597d70faf647f2f22` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.546372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bcf73-1897-46b5-a6ab-a56b7d481673 admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.559232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a2bd9-ba45-48b7-9908-74d7a5d6ecd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b08e2704cd264b6b8096da68b310420b, user_id=c84a9ca55a3f40d09e9e3097e09dfa22, role_id=59d226afaffe45f597d70faf647f2f22)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.560372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: WARNING py.warnings [None req-8f1a2bd9-ba45-48b7-9908-74d7a5d6ecd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:43:17.560372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: warnings.warn(msg) Jul 25 21:43:17.560372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: Jul 25 21:43:17.563584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a2bd9-ba45-48b7-9908-74d7a5d6ecd9 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.593141 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:17.597827 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 768/1554] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Jul 25 21:43:17 2022] PUT /identity/v3/projects/43e0650870cb41489254ce1cf893230e/users/2e2b38fe46634485acbaab1de5bb5a10/roles/59d226afaffe45f597d70faf647f2f22 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:43:17.603051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d82d8-aeec-412a-9dc6-e75825f52f99 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.603341 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d82d8-aeec-412a-9dc6-e75825f52f99 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.603643 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d82d8-aeec-412a-9dc6-e75825f52f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.614581 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 787/1555] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Jul 25 21:43:17 2022] PUT /identity/v3/projects/b08e2704cd264b6b8096da68b310420b/users/c84a9ca55a3f40d09e9e3097e09dfa22/roles/59d226afaffe45f597d70faf647f2f22 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:43:17.619838 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba260322-fcce-4e6b-abfd-50a0fdf75c89 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.620140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba260322-fcce-4e6b-abfd-50a0fdf75c89 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.620421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba260322-fcce-4e6b-abfd-50a0fdf75c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.623884 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-2b7d82d8-aeec-412a-9dc6-e75825f52f99 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:17.625101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-2b7d82d8-aeec-412a-9dc6-e75825f52f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:17.639504 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-ba260322-fcce-4e6b-abfd-50a0fdf75c89 None None] MFA Rules not processed for user `21d88c6eac2e460ca7e17f398e2ce9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:17.643299 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-ba260322-fcce-4e6b-abfd-50a0fdf75c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:17.685971 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:17.692133 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 769/1556] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:43:17.705600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 788/1557] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:43:17.705764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d82d8-aeec-412a-9dc6-e75825f52f99 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.713198 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba260322-fcce-4e6b-abfd-50a0fdf75c89 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:17.759477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d82d8-aeec-412a-9dc6-e75825f52f99 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.763808 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136b16f-09b0-45eb-9df3-f59a5b4fc19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.769356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136b16f-09b0-45eb-9df3-f59a5b4fc19e service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.769356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136b16f-09b0-45eb-9df3-f59a5b4fc19e service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.769356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136b16f-09b0-45eb-9df3-f59a5b4fc19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.771037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba260322-fcce-4e6b-abfd-50a0fdf75c89 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:17.775139 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136b16f-09b0-45eb-9df3-f59a5b4fc19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.775670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02a97f-2f3c-4e17-ae4e-ebeb605fa2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:17.776324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02a97f-2f3c-4e17-ae4e-ebeb605fa2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:17.776610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02a97f-2f3c-4e17-ae4e-ebeb605fa2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:17.776723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136b16f-09b0-45eb-9df3-f59a5b4fc19e service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.776886 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02a97f-2f3c-4e17-ae4e-ebeb605fa2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:17.786422 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02a97f-2f3c-4e17-ae4e-ebeb605fa2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:17.786612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 770/1558] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:43:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:43:17.788190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02a97f-2f3c-4e17-ae4e-ebeb605fa2c7 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:17.798709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 789/1559] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:43:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:43:25.288972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb19c67-3aed-4df0-9a2f-9c8cdd94d6c4 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.288972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb19c67-3aed-4df0-9a2f-9c8cdd94d6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.288972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb19c67-3aed-4df0-9a2f-9c8cdd94d6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.342219 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-dfb19c67-3aed-4df0-9a2f-9c8cdd94d6c4 None None] MFA Rules not processed for user `c84a9ca55a3f40d09e9e3097e09dfa22`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:25.343998 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-dfb19c67-3aed-4df0-9a2f-9c8cdd94d6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:25.447694 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 771/1560] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:43:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:43:25.452278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02a97f-2f3c-4e17-ae4e-ebeb605fa2c7 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:25.465249 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02a97f-2f3c-4e17-ae4e-ebeb605fa2c7 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:25.476945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d531055-a532-444c-8125-0fdf509b1f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:25.477831 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531055-a532-444c-8125-0fdf509b1f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.479623 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531055-a532-444c-8125-0fdf509b1f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.480251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531055-a532-444c-8125-0fdf509b1f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.481331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d531055-a532-444c-8125-0fdf509b1f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:25.512175 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d531055-a532-444c-8125-0fdf509b1f0d admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:25.617330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61db85-0e18-467e-9307-4af572eca193 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.618192 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61db85-0e18-467e-9307-4af572eca193 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.618662 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61db85-0e18-467e-9307-4af572eca193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.625858 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 790/1561] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Jul 25 21:43:25 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 21:43:25.630258 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d531055-a532-444c-8125-0fdf509b1f0d admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:25.664645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-dc61db85-0e18-467e-9307-4af572eca193 None None] MFA Rules not processed for user `2e2b38fe46634485acbaab1de5bb5a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:25.666056 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-dc61db85-0e18-467e-9307-4af572eca193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:25.706149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:25.727196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d531055-a532-444c-8125-0fdf509b1f0d admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:25.734110 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f55e9a-9e9e-421c-a51f-819d15acbae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:25.734972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f55e9a-9e9e-421c-a51f-819d15acbae5 admin admin] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.735363 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f55e9a-9e9e-421c-a51f-819d15acbae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.735775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f55e9a-9e9e-421c-a51f-819d15acbae5 admin admin] PATH_INFO: `/v3/users` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.736562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f55e9a-9e9e-421c-a51f-819d15acbae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:25.738617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f55e9a-9e9e-421c-a51f-819d15acbae5 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:25.791794 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 772/1562] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:43:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:43:25.793937 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61db85-0e18-467e-9307-4af572eca193 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:25.806907 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61db85-0e18-467e-9307-4af572eca193 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:25.812828 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d162ed-39a7-44d5-8a24-6db7ede079cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:25.813520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d162ed-39a7-44d5-8a24-6db7ede079cd admin admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.813952 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d162ed-39a7-44d5-8a24-6db7ede079cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.814237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d162ed-39a7-44d5-8a24-6db7ede079cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.814917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d162ed-39a7-44d5-8a24-6db7ede079cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:25.817039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d162ed-39a7-44d5-8a24-6db7ede079cd admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:25.833983 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 791/1563] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 21:43:25 2022] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:43:25.837642 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f55e9a-9e9e-421c-a51f-819d15acbae5 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:25.848466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f55e9a-9e9e-421c-a51f-819d15acbae5 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:25.853761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee5186-c240-4e36-9ac5-d32de2fbd90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:25.854390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5186-c240-4e36-9ac5-d32de2fbd90e admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.854670 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5186-c240-4e36-9ac5-d32de2fbd90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.854968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5186-c240-4e36-9ac5-d32de2fbd90e admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.855672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee5186-c240-4e36-9ac5-d32de2fbd90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:25.857327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee5186-c240-4e36-9ac5-d32de2fbd90e admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:25.868936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 792/1564] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Jul 25 21:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 21:43:25.873076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee5186-c240-4e36-9ac5-d32de2fbd90e admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:25.884040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee5186-c240-4e36-9ac5-d32de2fbd90e admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:25.888960 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca943e3-f514-482d-a47b-eb31b4e78a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:25.889703 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca943e3-f514-482d-a47b-eb31b4e78a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:25.893469 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca943e3-f514-482d-a47b-eb31b4e78a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:25.893469 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca943e3-f514-482d-a47b-eb31b4e78a24 admin admin] PATH_INFO: `/v3/projects/d1a04803a12845ddb497ca0d212b424a/users/2470de33312e49d98e36a5b83f483864/roles/11da9ce3f79148679dbde9eb2c568e55` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:25.906502 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca943e3-f514-482d-a47b-eb31b4e78a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a04803a12845ddb497ca0d212b424a, user_id=2470de33312e49d98e36a5b83f483864, role_id=11da9ce3f79148679dbde9eb2c568e55)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:25.909339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca943e3-f514-482d-a47b-eb31b4e78a24 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:25.919810 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 773/1565] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Jul 25 21:43:25 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:43:25.923980 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d162ed-39a7-44d5-8a24-6db7ede079cd admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:25.997787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d162ed-39a7-44d5-8a24-6db7ede079cd admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:25.998533 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 793/1566] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Jul 25 21:43:25 2022] PUT /identity/v3/projects/d1a04803a12845ddb497ca0d212b424a/users/2470de33312e49d98e36a5b83f483864/roles/11da9ce3f79148679dbde9eb2c568e55 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:43:26.002269 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca943e3-f514-482d-a47b-eb31b4e78a24 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:26.036872 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:26.083829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a1ebc-d57d-4394-a914-c50d7b4bcedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:26.084569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a1ebc-d57d-4394-a914-c50d7b4bcedb admin admin] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.084917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a1ebc-d57d-4394-a914-c50d7b4bcedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.085775 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a1ebc-d57d-4394-a914-c50d7b4bcedb admin admin] PATH_INFO: `/v3/users` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.086520 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a1ebc-d57d-4394-a914-c50d7b4bcedb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:26.088850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a1ebc-d57d-4394-a914-c50d7b4bcedb admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:26.109257 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca943e3-f514-482d-a47b-eb31b4e78a24 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:26.115397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc78a9b-02fa-422d-8e91-fe0944370068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:26.116079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc78a9b-02fa-422d-8e91-fe0944370068 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.117212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc78a9b-02fa-422d-8e91-fe0944370068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.117212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc78a9b-02fa-422d-8e91-fe0944370068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.118137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc78a9b-02fa-422d-8e91-fe0944370068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:26.119889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc78a9b-02fa-422d-8e91-fe0944370068 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:26.130988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 794/1567] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Jul 25 21:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 21:43:26.135802 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc78a9b-02fa-422d-8e91-fe0944370068 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:26.149395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc78a9b-02fa-422d-8e91-fe0944370068 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:26.152385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4fe83-92a5-4fbe-91fa-ecaf29a3fd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:26.153153 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4fe83-92a5-4fbe-91fa-ecaf29a3fd9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.153515 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4fe83-92a5-4fbe-91fa-ecaf29a3fd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.153892 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4fe83-92a5-4fbe-91fa-ecaf29a3fd9a admin admin] PATH_INFO: `/v3/projects/d1a04803a12845ddb497ca0d212b424a/users/2470de33312e49d98e36a5b83f483864/roles/11da9ce3f79148679dbde9eb2c568e55` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.156185 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4fe83-92a5-4fbe-91fa-ecaf29a3fd9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a04803a12845ddb497ca0d212b424a, user_id=2470de33312e49d98e36a5b83f483864, role_id=11da9ce3f79148679dbde9eb2c568e55)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:26.158925 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4fe83-92a5-4fbe-91fa-ecaf29a3fd9a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:26.171728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 795/1568] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Jul 25 21:43:26 2022] PUT /identity/v3/projects/d1a04803a12845ddb497ca0d212b424a/users/2470de33312e49d98e36a5b83f483864/roles/11da9ce3f79148679dbde9eb2c568e55 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:43:26.204274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 774/1569] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 25 21:43:25 2022] POST /identity/v3/users => generated 295 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 21:43:26.209528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4fe83-92a5-4fbe-91fa-ecaf29a3fd9a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:26.289873 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4fe83-92a5-4fbe-91fa-ecaf29a3fd9a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:26.296061 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a00eab-a244-40d7-a080-0aaed080fe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:26.296712 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a00eab-a244-40d7-a080-0aaed080fe32 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.296997 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a00eab-a244-40d7-a080-0aaed080fe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.297278 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a00eab-a244-40d7-a080-0aaed080fe32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.298098 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a00eab-a244-40d7-a080-0aaed080fe32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:26.299824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a00eab-a244-40d7-a080-0aaed080fe32 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:26.311387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 796/1570] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Jul 25 21:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:43:26.315974 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a1ebc-d57d-4394-a914-c50d7b4bcedb admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:26.327966 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a1ebc-d57d-4394-a914-c50d7b4bcedb admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:26.332943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ef864-c6b2-4255-9042-11f19a4bbaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:26.333644 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ef864-c6b2-4255-9042-11f19a4bbaa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.333930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ef864-c6b2-4255-9042-11f19a4bbaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.334213 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ef864-c6b2-4255-9042-11f19a4bbaa3 admin admin] PATH_INFO: `/v3/projects/d17f535422574d028695b8c23ef5372c/users/4665849d19fe495381931a3aad470b7c/roles/11da9ce3f79148679dbde9eb2c568e55` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.356078 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ef864-c6b2-4255-9042-11f19a4bbaa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17f535422574d028695b8c23ef5372c, user_id=4665849d19fe495381931a3aad470b7c, role_id=11da9ce3f79148679dbde9eb2c568e55)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:26.359470 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ef864-c6b2-4255-9042-11f19a4bbaa3 admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:26.416106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 775/1571] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Jul 25 21:43:26 2022] PUT /identity/v3/projects/d17f535422574d028695b8c23ef5372c/users/4665849d19fe495381931a3aad470b7c/roles/11da9ce3f79148679dbde9eb2c568e55 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:43:26.420419 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a00eab-a244-40d7-a080-0aaed080fe32 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:26.431774 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a00eab-a244-40d7-a080-0aaed080fe32 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:26.519302 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec618e3-6ec6-4460-8678-74b326b23d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:26.525412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec618e3-6ec6-4460-8678-74b326b23d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.525412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec618e3-6ec6-4460-8678-74b326b23d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.525412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec618e3-6ec6-4460-8678-74b326b23d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.525412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec618e3-6ec6-4460-8678-74b326b23d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:26.525412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec618e3-6ec6-4460-8678-74b326b23d18 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:26.536940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 797/1572] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Jul 25 21:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 21:43:26.541575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ef864-c6b2-4255-9042-11f19a4bbaa3 admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:26.554216 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ef864-c6b2-4255-9042-11f19a4bbaa3 admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:26.559978 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf40112-f545-42d3-af51-3a4517a558dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:26.560654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf40112-f545-42d3-af51-3a4517a558dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:26.560993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf40112-f545-42d3-af51-3a4517a558dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:26.561367 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf40112-f545-42d3-af51-3a4517a558dc admin admin] PATH_INFO: `/v3/projects/d17f535422574d028695b8c23ef5372c/users/4665849d19fe495381931a3aad470b7c/roles/11da9ce3f79148679dbde9eb2c568e55` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:26.563339 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf40112-f545-42d3-af51-3a4517a558dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17f535422574d028695b8c23ef5372c, user_id=4665849d19fe495381931a3aad470b7c, role_id=11da9ce3f79148679dbde9eb2c568e55)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:26.566164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf40112-f545-42d3-af51-3a4517a558dc admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:26.574086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:26.578759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 776/1573] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Jul 25 21:43:26 2022] PUT /identity/v3/projects/d17f535422574d028695b8c23ef5372c/users/4665849d19fe495381931a3aad470b7c/roles/11da9ce3f79148679dbde9eb2c568e55 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:43:33.836886 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f15883-0be8-4e9f-9faf-08584f26d5a7 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:33.837360 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f15883-0be8-4e9f-9faf-08584f26d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:33.837601 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f15883-0be8-4e9f-9faf-08584f26d5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:33.876079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-33f15883-0be8-4e9f-9faf-08584f26d5a7 None None] MFA Rules not processed for user `2470de33312e49d98e36a5b83f483864`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:33.876079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-33f15883-0be8-4e9f-9faf-08584f26d5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:33.915238 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:33.974921 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 798/1574] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:43:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:43:33.986492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf40112-f545-42d3-af51-3a4517a558dc admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:33.988817 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-ccf40112-f545-42d3-af51-3a4517a558dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:34.102437 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf40112-f545-42d3-af51-3a4517a558dc admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:34.106500 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc63caf-e427-44e6-84e8-cf4f855ca140 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ceb49020974e89b264c2a874dd82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:34.108342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc63caf-e427-44e6-84e8-cf4f855ca140 service glance] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:34.108342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc63caf-e427-44e6-84e8-cf4f855ca140 service glance] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:34.108342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc63caf-e427-44e6-84e8-cf4f855ca140 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:34.181332 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc63caf-e427-44e6-84e8-cf4f855ca140 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:34.182879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc63caf-e427-44e6-84e8-cf4f855ca140 service glance] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:34.193938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 777/1575] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:43:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:43:34.590242 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae12043-eb1a-4e1f-8e66-09c165058863 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:34.590533 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae12043-eb1a-4e1f-8e66-09c165058863 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:34.590814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae12043-eb1a-4e1f-8e66-09c165058863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:34.677610 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-3ae12043-eb1a-4e1f-8e66-09c165058863 None None] MFA Rules not processed for user `586e22d3792b4759a38ab4c3bc12cf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:34.680201 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3ae12043-eb1a-4e1f-8e66-09c165058863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:34.763526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 799/1576] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 21:43:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:43:34.799196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37856605-1ff8-4f02-8eff-df67d607ddd7 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:34.799483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37856605-1ff8-4f02-8eff-df67d607ddd7 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:34.799783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37856605-1ff8-4f02-8eff-df67d607ddd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:34.830372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-37856605-1ff8-4f02-8eff-df67d607ddd7 None None] MFA Rules not processed for user `4665849d19fe495381931a3aad470b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:34.831603 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-37856605-1ff8-4f02-8eff-df67d607ddd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:34.908719 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 778/1577] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:43:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:43:34.922231 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae12043-eb1a-4e1f-8e66-09c165058863 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:34.932558 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae12043-eb1a-4e1f-8e66-09c165058863 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:34.936217 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfcb8f-0b87-4ee3-91c8-50c043e9cf66 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ceb49020974e89b264c2a874dd82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:34.936833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfcb8f-0b87-4ee3-91c8-50c043e9cf66 service glance] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:34.937116 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfcb8f-0b87-4ee3-91c8-50c043e9cf66 service glance] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:34.937390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfcb8f-0b87-4ee3-91c8-50c043e9cf66 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:35.009974 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfcb8f-0b87-4ee3-91c8-50c043e9cf66 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:35.011694 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfcb8f-0b87-4ee3-91c8-50c043e9cf66 service glance] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:35.023552 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 800/1578] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:43:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:43:35.099429 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37856605-1ff8-4f02-8eff-df67d607ddd7 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:35.101645 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-37856605-1ff8-4f02-8eff-df67d607ddd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:35.135248 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=100 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:35.222694 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37856605-1ff8-4f02-8eff-df67d607ddd7 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:35.229177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2938d-6a06-474b-87b2-9af892423a14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4863a61a484ed4b0dac01e908cd05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:35.229807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2938d-6a06-474b-87b2-9af892423a14 service swift] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:35.230087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2938d-6a06-474b-87b2-9af892423a14 service swift] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:35.230358 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2938d-6a06-474b-87b2-9af892423a14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:35.239436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2938d-6a06-474b-87b2-9af892423a14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:35.241146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2938d-6a06-474b-87b2-9af892423a14 service swift] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:35.250478 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 779/1579] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 21:43:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 21:43:37.467560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba683e6-2465-4805-a5ef-461251c1adb1 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:37.468160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba683e6-2465-4805-a5ef-461251c1adb1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:37.468160 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba683e6-2465-4805-a5ef-461251c1adb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:37.492415 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-bba683e6-2465-4805-a5ef-461251c1adb1 None None] MFA Rules not processed for user `586e22d3792b4759a38ab4c3bc12cf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:37.493941 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-bba683e6-2465-4805-a5ef-461251c1adb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:37.510245 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 801/1580] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 21:43:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:43:37.532936 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2938d-6a06-474b-87b2-9af892423a14 service swift] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:37.550661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2938d-6a06-474b-87b2-9af892423a14 service swift] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:37.556788 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bacbf-f3b8-4c3f-abf4-b8a0fed33f1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4863a61a484ed4b0dac01e908cd05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:37.557746 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bacbf-f3b8-4c3f-abf4-b8a0fed33f1a service swift] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:37.559271 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bacbf-f3b8-4c3f-abf4-b8a0fed33f1a service swift] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:37.559791 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bacbf-f3b8-4c3f-abf4-b8a0fed33f1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:37.569284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bacbf-f3b8-4c3f-abf4-b8a0fed33f1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:37.571404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bacbf-f3b8-4c3f-abf4-b8a0fed33f1a service swift] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:37.591854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 780/1581] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 21:43:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:43:47.291874 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103c5d-1240-44cb-bca4-b7d089b98500 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.292829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103c5d-1240-44cb-bca4-b7d089b98500 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.292829 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f103c5d-1240-44cb-bca4-b7d089b98500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.316596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-3f103c5d-1240-44cb-bca4-b7d089b98500 None None] MFA Rules not processed for user `c84a9ca55a3f40d09e9e3097e09dfa22`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:47.317799 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3f103c5d-1240-44cb-bca4-b7d089b98500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:47.325331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 802/1582] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:43:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:43:47.583663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=38 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:47.623091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847afa9-8d20-4703-96fb-9375eac02380 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.623384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847afa9-8d20-4703-96fb-9375eac02380 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.623674 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847afa9-8d20-4703-96fb-9375eac02380 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.625052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 781/1583] 10.222.0.27 () {54 vars in 962 bytes} [Mon Jul 25 21:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:47.630254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985c729-6b18-4b43-894c-5d453a5538cb None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.630539 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985c729-6b18-4b43-894c-5d453a5538cb None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.630807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985c729-6b18-4b43-894c-5d453a5538cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.668916 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-9985c729-6b18-4b43-894c-5d453a5538cb None None] MFA Rules not processed for user `7d3d6613476c445b82302df5025f3ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:47.670418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9985c729-6b18-4b43-894c-5d453a5538cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:47.674993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:43:47.738232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 803/1584] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Jul 25 21:43:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:43:47.743535 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac923f-d051-4e21-beeb-43ffb2d1f6e5 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.743879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac923f-d051-4e21-beeb-43ffb2d1f6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.744164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac923f-d051-4e21-beeb-43ffb2d1f6e5 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.745501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 782/1585] 10.222.0.27 () {54 vars in 912 bytes} [Mon Jul 25 21:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:47.750612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a1fc3-de69-4ffa-8427-6e5b3de7487a None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.750906 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a1fc3-de69-4ffa-8427-6e5b3de7487a None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.751511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a1fc3-de69-4ffa-8427-6e5b3de7487a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.772889 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-e27a1fc3-de69-4ffa-8427-6e5b3de7487a None None] MFA Rules not processed for user `7d3d6613476c445b82302df5025f3ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:47.774312 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-e27a1fc3-de69-4ffa-8427-6e5b3de7487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:47.783842 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 804/1586] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 21:43:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:43:47.795651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac923f-d051-4e21-beeb-43ffb2d1f6e5 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:47.797415 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-bdac923f-d051-4e21-beeb-43ffb2d1f6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:47.810814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac923f-d051-4e21-beeb-43ffb2d1f6e5 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:47.814335 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e7ee2-c4ad-49d2-9b03-c74073fe3e0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ceb49020974e89b264c2a874dd82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:47.814938 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e7ee2-c4ad-49d2-9b03-c74073fe3e0f service glance] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:47.815221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e7ee2-c4ad-49d2-9b03-c74073fe3e0f service glance] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:47.815494 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e7ee2-c4ad-49d2-9b03-c74073fe3e0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:47.826009 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e7ee2-c4ad-49d2-9b03-c74073fe3e0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:47.827517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e7ee2-c4ad-49d2-9b03-c74073fe3e0f service glance] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:47.838600 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 783/1587] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:43:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:43:48.176778 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0ac8c-eb15-4c42-9e6b-382b4e8cb138 None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.177073 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0ac8c-eb15-4c42-9e6b-382b4e8cb138 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.177354 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0ac8c-eb15-4c42-9e6b-382b4e8cb138 None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.179404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 805/1588] 10.222.0.27 () {54 vars in 912 bytes} [Mon Jul 25 21:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:48.184466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9392b3-4e0f-4797-8bf9-d715ca832438 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.184759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9392b3-4e0f-4797-8bf9-d715ca832438 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.185042 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9392b3-4e0f-4797-8bf9-d715ca832438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.224047 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-0f9392b3-4e0f-4797-8bf9-d715ca832438 None None] MFA Rules not processed for user `b428f7d0d62049cf8fbbd05830d0d356`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:48.225785 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-0f9392b3-4e0f-4797-8bf9-d715ca832438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:48.278183 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 784/1589] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 21:43:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:43:48.289860 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0ac8c-eb15-4c42-9e6b-382b4e8cb138 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:48.291516 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-86c0ac8c-eb15-4c42-9e6b-382b4e8cb138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:48.305659 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0ac8c-eb15-4c42-9e6b-382b4e8cb138 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:48.309440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a90955-758e-4190-bf5d-c02343f65636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:48.310039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a90955-758e-4190-bf5d-c02343f65636 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.310316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a90955-758e-4190-bf5d-c02343f65636 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.310588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a90955-758e-4190-bf5d-c02343f65636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.317521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a90955-758e-4190-bf5d-c02343f65636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:48.319440 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a90955-758e-4190-bf5d-c02343f65636 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:48.327506 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 806/1590] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:43:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:43:48.839489 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac31b03-5a84-4466-82a1-a93347e539de None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.839973 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac31b03-5a84-4466-82a1-a93347e539de None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.840324 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac31b03-5a84-4466-82a1-a93347e539de None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.841768 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 785/1591] 10.222.0.27 () {54 vars in 962 bytes} [Mon Jul 25 21:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:43:48.847377 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4835aa0-7def-4d2c-b9a0-5f83770f9f10 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.847665 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4835aa0-7def-4d2c-b9a0-5f83770f9f10 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.847975 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4835aa0-7def-4d2c-b9a0-5f83770f9f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.854026 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414af7e1-ca09-46b3-9281-14717d379055 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.854313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414af7e1-ca09-46b3-9281-14717d379055 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.854591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414af7e1-ca09-46b3-9281-14717d379055 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.855953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 786/1592] 10.222.0.27 () {54 vars in 961 bytes} [Mon Jul 25 21:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:43:48.862783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a8209-d1b5-4fc5-bd79-2b0658b95815 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.863295 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a8209-d1b5-4fc5-bd79-2b0658b95815 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.863855 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a8209-d1b5-4fc5-bd79-2b0658b95815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.868714 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-a4835aa0-7def-4d2c-b9a0-5f83770f9f10 None None] MFA Rules not processed for user `7d3d6613476c445b82302df5025f3ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:48.870015 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a4835aa0-7def-4d2c-b9a0-5f83770f9f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:48.879785 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 807/1593] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Jul 25 21:43:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:43:48.886569 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4e874-505e-403d-83bb-a168d62cbaae None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.886927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4e874-505e-403d-83bb-a168d62cbaae None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.887129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-573a8209-d1b5-4fc5-bd79-2b0658b95815 None None] MFA Rules not processed for user `6076b9f003c749348fcddef6f6ed28e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:48.887331 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4e874-505e-403d-83bb-a168d62cbaae None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.888369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-573a8209-d1b5-4fc5-bd79-2b0658b95815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:48.889105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 808/1594] 10.222.0.27 () {54 vars in 912 bytes} [Mon Jul 25 21:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:43:48.893450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c122-cea6-41d7-8f30-f4161ec46183 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.893738 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c122-cea6-41d7-8f30-f4161ec46183 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.894011 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c122-cea6-41d7-8f30-f4161ec46183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.914286 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-0127c122-cea6-41d7-8f30-f4161ec46183 None None] MFA Rules not processed for user `7d3d6613476c445b82302df5025f3ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:48.915551 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0127c122-cea6-41d7-8f30-f4161ec46183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:48.925220 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 809/1595] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 21:43:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:43:48.936676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127c122-cea6-41d7-8f30-f4161ec46183 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:48.946223 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127c122-cea6-41d7-8f30-f4161ec46183 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:48.949732 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f17bb-8c13-4770-bf94-f1f76edb46b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:48.950334 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f17bb-8c13-4770-bf94-f1f76edb46b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.950617 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f17bb-8c13-4770-bf94-f1f76edb46b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.950891 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f17bb-8c13-4770-bf94-f1f76edb46b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.954296 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 787/1596] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Jul 25 21:43:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:43:48.962233 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f17bb-8c13-4770-bf94-f1f76edb46b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:48.962503 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a8209-d1b5-4fc5-bd79-2b0658b95815 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:48.963666 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f17bb-8c13-4770-bf94-f1f76edb46b9 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:48.972029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a8209-d1b5-4fc5-bd79-2b0658b95815 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:48.974442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 810/1597] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:43:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:43:48.977418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe7106-ca4b-4ce4-ad33-9d6c1b37af76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6076b9f003c749348fcddef6f6ed28e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:48.978039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe7106-ca4b-4ce4-ad33-9d6c1b37af76 service placement] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:48.978325 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe7106-ca4b-4ce4-ad33-9d6c1b37af76 service placement] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:48.978605 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe7106-ca4b-4ce4-ad33-9d6c1b37af76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:48.980395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-15fe7106-ca4b-4ce4-ad33-9d6c1b37af76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:48.992267 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe7106-ca4b-4ce4-ad33-9d6c1b37af76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:48.993943 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe7106-ca4b-4ce4-ad33-9d6c1b37af76 service placement] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:49.008618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 788/1598] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:43:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:43:52.135045 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6131a-f8a0-44c1-a9d2-ea88279ca26f None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.135560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6131a-f8a0-44c1-a9d2-ea88279ca26f None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.135642 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6131a-f8a0-44c1-a9d2-ea88279ca26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.155495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-baa6131a-f8a0-44c1-a9d2-ea88279ca26f None None] MFA Rules not processed for user `586e22d3792b4759a38ab4c3bc12cf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:43:52.156760 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-baa6131a-f8a0-44c1-a9d2-ea88279ca26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:43:52.164545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 811/1599] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 21:43:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:43:52.177197 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe7106-ca4b-4ce4-ad33-9d6c1b37af76 service placement] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:43:52.189319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe7106-ca4b-4ce4-ad33-9d6c1b37af76 service placement] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:43:52.194403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc2d35-0fb9-4143-8f4d-d86438d41a21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4863a61a484ed4b0dac01e908cd05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:43:52.196397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc2d35-0fb9-4143-8f4d-d86438d41a21 service swift] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:43:52.196397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc2d35-0fb9-4143-8f4d-d86438d41a21 service swift] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:43:52.196397 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc2d35-0fb9-4143-8f4d-d86438d41a21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:43:52.204392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc2d35-0fb9-4143-8f4d-d86438d41a21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:43:52.205987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc2d35-0fb9-4143-8f4d-d86438d41a21 service swift] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:43:52.214247 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 789/1600] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 21:43:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:44:01.050508 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c3448-7c96-4e99-80a1-48f5eaed1a3e None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:01.050985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c3448-7c96-4e99-80a1-48f5eaed1a3e None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:01.051086 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c3448-7c96-4e99-80a1-48f5eaed1a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:01.071136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-0f2c3448-7c96-4e99-80a1-48f5eaed1a3e None None] MFA Rules not processed for user `b428f7d0d62049cf8fbbd05830d0d356`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:01.073423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-0f2c3448-7c96-4e99-80a1-48f5eaed1a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:01.079767 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 812/1601] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Jul 25 21:44:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:44:01.092709 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc2d35-0fb9-4143-8f4d-d86438d41a21 service swift] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:01.106687 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc2d35-0fb9-4143-8f4d-d86438d41a21 service swift] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:01.110746 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfaf1a-c241-4c47-acde-49a431b45256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:01.111362 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfaf1a-c241-4c47-acde-49a431b45256 service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:01.111641 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfaf1a-c241-4c47-acde-49a431b45256 service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:01.111945 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfaf1a-c241-4c47-acde-49a431b45256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:01.120372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfaf1a-c241-4c47-acde-49a431b45256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:01.121784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfaf1a-c241-4c47-acde-49a431b45256 service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:01.129849 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 790/1602] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:44:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:44:02.070026 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d59cbe-e0da-4c9b-9d49-cde9f3fe599c None None] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:02.070635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d59cbe-e0da-4c9b-9d49-cde9f3fe599c None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:02.070908 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d59cbe-e0da-4c9b-9d49-cde9f3fe599c None None] PATH_INFO: `/` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:02.073024 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 813/1603] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 21:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:02.084534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f366ccc-3c9b-4f02-b764-175b843ab6c9 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:02.084839 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f366ccc-3c9b-4f02-b764-175b843ab6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:02.086008 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f366ccc-3c9b-4f02-b764-175b843ab6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:02.110368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-4f366ccc-3c9b-4f02-b764-175b843ab6c9 None None] MFA Rules not processed for user `7d3d6613476c445b82302df5025f3ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:02.111689 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-4f366ccc-3c9b-4f02-b764-175b843ab6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:02.123651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 791/1604] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 21:44:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:44:02.176536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d59cbe-e0da-4c9b-9d49-cde9f3fe599c None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:02.192403 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d59cbe-e0da-4c9b-9d49-cde9f3fe599c None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:02.199079 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb98ed7-4311-41a7-8179-5fd8c8229540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:02.200059 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb98ed7-4311-41a7-8179-5fd8c8229540 service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:02.200342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb98ed7-4311-41a7-8179-5fd8c8229540 service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:02.200618 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb98ed7-4311-41a7-8179-5fd8c8229540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:02.222540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb98ed7-4311-41a7-8179-5fd8c8229540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:02.224483 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb98ed7-4311-41a7-8179-5fd8c8229540 service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:02.237646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 814/1605] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:44:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:44:08.883237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe183b-29cc-4832-8b94-4089580f642d None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:08.885099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe183b-29cc-4832-8b94-4089580f642d None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:08.885099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe183b-29cc-4832-8b94-4089580f642d None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:08.886148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 792/1606] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 21:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:44:08.897212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8bf43-aafe-4278-af93-0a4b271eeea1 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:08.897673 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8bf43-aafe-4278-af93-0a4b271eeea1 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:08.897773 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8bf43-aafe-4278-af93-0a4b271eeea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:08.917355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-1ba8bf43-aafe-4278-af93-0a4b271eeea1 None None] MFA Rules not processed for user `7d3d6613476c445b82302df5025f3ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:08.918568 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-1ba8bf43-aafe-4278-af93-0a4b271eeea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:08.928062 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 815/1607] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 21:44:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:44:08.942357 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe183b-29cc-4832-8b94-4089580f642d None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:08.957268 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe183b-29cc-4832-8b94-4089580f642d None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:08.962843 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85bf22-a98a-4939-bd69-e78eaf7b2a57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:08.963445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85bf22-a98a-4939-bd69-e78eaf7b2a57 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:08.963728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85bf22-a98a-4939-bd69-e78eaf7b2a57 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:08.964032 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85bf22-a98a-4939-bd69-e78eaf7b2a57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:08.973127 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85bf22-a98a-4939-bd69-e78eaf7b2a57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:08.974754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85bf22-a98a-4939-bd69-e78eaf7b2a57 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:08.986292 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 793/1608] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:44:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:44:18.912387 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=63 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:18.981930 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=91 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:30.373832 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8bf43-aafe-4278-af93-0a4b271eeea1 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:30.384251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8bf43-aafe-4278-af93-0a4b271eeea1 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:30.387878 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79d7e8-07bb-4358-8d2a-aab953cb4c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:30.388492 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79d7e8-07bb-4358-8d2a-aab953cb4c5f service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:30.388776 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79d7e8-07bb-4358-8d2a-aab953cb4c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:30.389050 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79d7e8-07bb-4358-8d2a-aab953cb4c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:30.398035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79d7e8-07bb-4358-8d2a-aab953cb4c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:30.399481 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79d7e8-07bb-4358-8d2a-aab953cb4c5f service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:30.409284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 816/1609] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:44:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:44:37.499642 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71144bd8-5c1a-4140-9c5d-ab1161da5676 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:37.500185 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71144bd8-5c1a-4140-9c5d-ab1161da5676 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:37.500271 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71144bd8-5c1a-4140-9c5d-ab1161da5676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:37.519274 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-71144bd8-5c1a-4140-9c5d-ab1161da5676 None None] MFA Rules not processed for user `2e2b38fe46634485acbaab1de5bb5a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:37.520534 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-71144bd8-5c1a-4140-9c5d-ab1161da5676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:37.527430 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 794/1610] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:44:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:44:37.983092 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60ad63-ddd5-466a-a513-895ab6e78863 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:37.983592 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60ad63-ddd5-466a-a513-895ab6e78863 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:37.983764 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60ad63-ddd5-466a-a513-895ab6e78863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:38.004319 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4e60ad63-ddd5-466a-a513-895ab6e78863 None None] MFA Rules not processed for user `b428f7d0d62049cf8fbbd05830d0d356`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:44:38.005526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4e60ad63-ddd5-466a-a513-895ab6e78863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:44:38.012155 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 817/1611] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 21:44:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:44:38.025152 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71144bd8-5c1a-4140-9c5d-ab1161da5676 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:44:38.034968 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71144bd8-5c1a-4140-9c5d-ab1161da5676 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:44:38.038588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277566c8-34b5-4c42-a25e-926b0dedf485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:44:38.039221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277566c8-34b5-4c42-a25e-926b0dedf485 service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:44:38.039505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277566c8-34b5-4c42-a25e-926b0dedf485 service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:44:38.039804 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277566c8-34b5-4c42-a25e-926b0dedf485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:44:38.048919 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277566c8-34b5-4c42-a25e-926b0dedf485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:44:38.050368 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277566c8-34b5-4c42-a25e-926b0dedf485 service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:44:38.059346 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 795/1612] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:44:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:44:47.998384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=9 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:44:48.055420 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=9 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:24.376102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b2a0f-a630-449a-8897-f4eefb1389ee None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:24.376643 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b2a0f-a630-449a-8897-f4eefb1389ee None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:24.376643 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b2a0f-a630-449a-8897-f4eefb1389ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:24.395395 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-243b2a0f-a630-449a-8897-f4eefb1389ee None None] MFA Rules not processed for user `2e2b38fe46634485acbaab1de5bb5a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:45:24.396622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-243b2a0f-a630-449a-8897-f4eefb1389ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:45:24.403761 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 818/1613] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:45:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:45:34.390254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:43.160484 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be89fa-82ad-4e66-8278-b41f5e4b8c50 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:43.161087 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be89fa-82ad-4e66-8278-b41f5e4b8c50 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:43.161204 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be89fa-82ad-4e66-8278-b41f5e4b8c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:43.182353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-a4be89fa-82ad-4e66-8278-b41f5e4b8c50 None None] MFA Rules not processed for user `586e22d3792b4759a38ab4c3bc12cf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:45:43.183536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-a4be89fa-82ad-4e66-8278-b41f5e4b8c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:45:43.191054 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 796/1614] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 21:45:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:45:43.238661 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b2a0f-a630-449a-8897-f4eefb1389ee None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:45:43.251922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b2a0f-a630-449a-8897-f4eefb1389ee None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:45:43.257051 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdcafe-0648-45af-b16a-6c46b66b2bab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4863a61a484ed4b0dac01e908cd05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:45:43.257665 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdcafe-0648-45af-b16a-6c46b66b2bab service swift] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:43.257947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdcafe-0648-45af-b16a-6c46b66b2bab service swift] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:43.258221 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdcafe-0648-45af-b16a-6c46b66b2bab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:43.267037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdcafe-0648-45af-b16a-6c46b66b2bab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:45:43.268655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdcafe-0648-45af-b16a-6c46b66b2bab service swift] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:45:43.277783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 819/1615] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 21:45:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:45:46.725660 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ffa83-315d-4d73-bca1-09e550c84636 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:45:46.726194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ffa83-315d-4d73-bca1-09e550c84636 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:45:46.726194 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ffa83-315d-4d73-bca1-09e550c84636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:45:46.746311 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-5b5ffa83-315d-4d73-bca1-09e550c84636 None None] MFA Rules not processed for user `2e2b38fe46634485acbaab1de5bb5a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:45:46.747536 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-5b5ffa83-315d-4d73-bca1-09e550c84636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:45:46.754512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 797/1616] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:45:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:45:53.273505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=6 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:45:56.740672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=6 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:20.209787 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f01bb7-c27d-4974-8c08-c127a89a3be7 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:20.210279 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f01bb7-c27d-4974-8c08-c127a89a3be7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:20.210369 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f01bb7-c27d-4974-8c08-c127a89a3be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:20.230822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-59f01bb7-c27d-4974-8c08-c127a89a3be7 None None] MFA Rules not processed for user `586e22d3792b4759a38ab4c3bc12cf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:46:20.231991 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-59f01bb7-c27d-4974-8c08-c127a89a3be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:46:20.239129 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 820/1617] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 25 21:46:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:46:20.251477 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ffa83-315d-4d73-bca1-09e550c84636 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:20.263083 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ffa83-315d-4d73-bca1-09e550c84636 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:20.268748 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7128a-91c7-480b-89be-86f957ff9968 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4863a61a484ed4b0dac01e908cd05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:20.269389 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7128a-91c7-480b-89be-86f957ff9968 service swift] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:20.269672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7128a-91c7-480b-89be-86f957ff9968 service swift] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:20.269946 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7128a-91c7-480b-89be-86f957ff9968 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:20.277781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7128a-91c7-480b-89be-86f957ff9968 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:20.279379 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7128a-91c7-480b-89be-86f957ff9968 service swift] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:20.288195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 798/1618] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 21:46:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:46:30.226027 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:30.284947 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=6 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:36.196774 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f01bb7-c27d-4974-8c08-c127a89a3be7 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:36.209900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f01bb7-c27d-4974-8c08-c127a89a3be7 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:36.214837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f122b4-be96-48d2-9a2b-422eddbfd59d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6076b9f003c749348fcddef6f6ed28e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:36.215452 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f122b4-be96-48d2-9a2b-422eddbfd59d service placement] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:36.215733 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f122b4-be96-48d2-9a2b-422eddbfd59d service placement] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:36.216041 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f122b4-be96-48d2-9a2b-422eddbfd59d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:36.224614 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f122b4-be96-48d2-9a2b-422eddbfd59d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:36.226196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f122b4-be96-48d2-9a2b-422eddbfd59d service placement] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:36.235837 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 821/1619] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:46:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:46:41.323465 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3660d9-1f1f-468a-9258-b98efc59c716 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:41.324002 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3660d9-1f1f-468a-9258-b98efc59c716 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:41.324091 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3660d9-1f1f-468a-9258-b98efc59c716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:41.342375 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-ed3660d9-1f1f-468a-9258-b98efc59c716 None None] MFA Rules not processed for user `2e2b38fe46634485acbaab1de5bb5a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:46:41.343574 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-ed3660d9-1f1f-468a-9258-b98efc59c716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:46:41.350676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 799/1620] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:46:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:46:46.231911 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=6 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:51.337779 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=3 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:46:58.851571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f122b4-be96-48d2-9a2b-422eddbfd59d service placement] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:46:58.860517 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f122b4-be96-48d2-9a2b-422eddbfd59d service placement] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:46:58.864077 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306e712-9e2c-4cd1-82f4-2bb69fb401d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:46:58.864678 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306e712-9e2c-4cd1-82f4-2bb69fb401d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:46:58.864984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306e712-9e2c-4cd1-82f4-2bb69fb401d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:46:58.865265 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306e712-9e2c-4cd1-82f4-2bb69fb401d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:46:58.875065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306e712-9e2c-4cd1-82f4-2bb69fb401d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:46:58.876526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306e712-9e2c-4cd1-82f4-2bb69fb401d8 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:46:58.885853 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 822/1621] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:46:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:47:01.194512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9486d-b60b-4f21-94c5-cf8219f23792 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:01.195022 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9486d-b60b-4f21-94c5-cf8219f23792 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:01.195239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9486d-b60b-4f21-94c5-cf8219f23792 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:01.196988 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 800/1622] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 21:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:47:01.202111 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cc802-df89-489d-b7a2-ca7eccc129c6 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:01.203178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cc802-df89-489d-b7a2-ca7eccc129c6 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:01.203178 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cc802-df89-489d-b7a2-ca7eccc129c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:01.222883 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-831cc802-df89-489d-b7a2-ca7eccc129c6 None None] MFA Rules not processed for user `7d3d6613476c445b82302df5025f3ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:47:01.224140 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-831cc802-df89-489d-b7a2-ca7eccc129c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:47:01.234177 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 823/1623] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 21:47:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:47:01.247433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9486d-b60b-4f21-94c5-cf8219f23792 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:47:01.263806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9486d-b60b-4f21-94c5-cf8219f23792 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:47:01.269335 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7f84e-3259-4b88-877c-df30d910bef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:47:01.270033 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7f84e-3259-4b88-877c-df30d910bef4 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:47:01.270380 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7f84e-3259-4b88-877c-df30d910bef4 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:47:01.270719 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7f84e-3259-4b88-877c-df30d910bef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:47:01.280731 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7f84e-3259-4b88-877c-df30d910bef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:47:01.282385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7f84e-3259-4b88-877c-df30d910bef4 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:47:01.293505 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 801/1624] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:47:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:47:11.217909 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=9 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:47:11.289752 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=6 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:48:58.533803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cc802-df89-489d-b7a2-ca7eccc129c6 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:58.545040 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cc802-df89-489d-b7a2-ca7eccc129c6 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:58.550486 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bb480-b907-4315-89dd-76499fb849be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:58.551099 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb480-b907-4315-89dd-76499fb849be service nova] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:58.551381 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb480-b907-4315-89dd-76499fb849be service nova] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:58.551655 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bb480-b907-4315-89dd-76499fb849be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:58.560501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bb480-b907-4315-89dd-76499fb849be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:58.562143 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6bb480-b907-4315-89dd-76499fb849be service nova] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:58.571239 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 824/1625] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:58.976313 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7f84e-3259-4b88-877c-df30d910bef4 service nova] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:58.988237 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7f84e-3259-4b88-877c-df30d910bef4 service nova] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:58.994826 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd425aa-7eb5-4645-8ff5-1e70b2114614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:59.000806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd425aa-7eb5-4645-8ff5-1e70b2114614 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:59.000806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd425aa-7eb5-4645-8ff5-1e70b2114614 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:59.000806 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd425aa-7eb5-4645-8ff5-1e70b2114614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:59.004353 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd425aa-7eb5-4645-8ff5-1e70b2114614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:59.005927 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd425aa-7eb5-4645-8ff5-1e70b2114614 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:59.014820 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 802/1626] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:59.098807 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bb480-b907-4315-89dd-76499fb849be service nova] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:59.108557 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6bb480-b907-4315-89dd-76499fb849be service nova] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:59.112323 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd27bc0-0f60-4759-96cc-940cd2b91ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:59.112940 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd27bc0-0f60-4759-96cc-940cd2b91ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:59.113250 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd27bc0-0f60-4759-96cc-940cd2b91ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:59.113523 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd27bc0-0f60-4759-96cc-940cd2b91ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:59.124074 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd27bc0-0f60-4759-96cc-940cd2b91ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:59.125501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd27bc0-0f60-4759-96cc-940cd2b91ba1 service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:59.136170 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 825/1627] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:48:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:48:59.404093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e1e5f-55ae-4e5d-8ebc-456933be4773 None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:59.404385 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e1e5f-55ae-4e5d-8ebc-456933be4773 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:59.404663 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e1e5f-55ae-4e5d-8ebc-456933be4773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:59.423131 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-6e4e1e5f-55ae-4e5d-8ebc-456933be4773 None None] MFA Rules not processed for user `586e22d3792b4759a38ab4c3bc12cf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:48:59.424366 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-6e4e1e5f-55ae-4e5d-8ebc-456933be4773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:48:59.431728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 803/1628] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 25 21:48:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:48:59.573316 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd27bc0-0f60-4759-96cc-940cd2b91ba1 service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:48:59.584924 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd27bc0-0f60-4759-96cc-940cd2b91ba1 service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:48:59.589868 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43c4a3-8dd2-4d74-98f6-a9fccade3304 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4863a61a484ed4b0dac01e908cd05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:48:59.591105 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43c4a3-8dd2-4d74-98f6-a9fccade3304 service swift] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:48:59.591384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43c4a3-8dd2-4d74-98f6-a9fccade3304 service swift] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:48:59.591658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43c4a3-8dd2-4d74-98f6-a9fccade3304 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:48:59.599518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43c4a3-8dd2-4d74-98f6-a9fccade3304 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:48:59.601136 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43c4a3-8dd2-4d74-98f6-a9fccade3304 service swift] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:48:59.609384 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 826/1629] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 21:48:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:49:00.847671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae386b-79b4-44d3-b47a-d4e993db227f None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:00.847671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae386b-79b4-44d3-b47a-d4e993db227f None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:00.847671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae386b-79b4-44d3-b47a-d4e993db227f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:00.847671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-eaae386b-79b4-44d3-b47a-d4e993db227f None None] MFA Rules not processed for user `586e22d3792b4759a38ab4c3bc12cf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:00.847671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-eaae386b-79b4-44d3-b47a-d4e993db227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:00.847671 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 804/1630] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 21:49:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:00.848780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43c4a3-8dd2-4d74-98f6-a9fccade3304 service swift] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:00.848780 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43c4a3-8dd2-4d74-98f6-a9fccade3304 service swift] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:00.851005 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60074f58-5af1-40f9-982a-4a5756dc4a13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4863a61a484ed4b0dac01e908cd05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:00.851621 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60074f58-5af1-40f9-982a-4a5756dc4a13 service swift] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:00.851934 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60074f58-5af1-40f9-982a-4a5756dc4a13 service swift] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:00.856946 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60074f58-5af1-40f9-982a-4a5756dc4a13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:00.861656 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60074f58-5af1-40f9-982a-4a5756dc4a13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:00.863361 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60074f58-5af1-40f9-982a-4a5756dc4a13 service swift] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:00.872411 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 827/1631] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 21:49:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:49:02.167728 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae386b-79b4-44d3-b47a-d4e993db227f None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:02.189861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae386b-79b4-44d3-b47a-d4e993db227f None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:02.204772 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288707d-87bd-4656-ae98-d088759e9c24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:02.206006 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288707d-87bd-4656-ae98-d088759e9c24 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:02.206392 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288707d-87bd-4656-ae98-d088759e9c24 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:02.206879 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288707d-87bd-4656-ae98-d088759e9c24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:02.225499 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288707d-87bd-4656-ae98-d088759e9c24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:02.227622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288707d-87bd-4656-ae98-d088759e9c24 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:02.240542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 805/1632] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:03.824566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d74eb-05be-4c82-8b2c-f8b3d68fe0a7 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:03.826309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d74eb-05be-4c82-8b2c-f8b3d68fe0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:03.826309 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d74eb-05be-4c82-8b2c-f8b3d68fe0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:03.845593 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4d0d74eb-05be-4c82-8b2c-f8b3d68fe0a7 None None] MFA Rules not processed for user `2e2b38fe46634485acbaab1de5bb5a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:03.846822 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4d0d74eb-05be-4c82-8b2c-f8b3d68fe0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:03.854102 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 828/1633] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:49:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:04.185844 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288707d-87bd-4656-ae98-d088759e9c24 service nova] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:04.195877 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288707d-87bd-4656-ae98-d088759e9c24 service nova] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:04.199781 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4728cd7-80b2-4e84-bc63-d854ff44d83d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:04.200436 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4728cd7-80b2-4e84-bc63-d854ff44d83d service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:04.200741 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4728cd7-80b2-4e84-bc63-d854ff44d83d service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:04.201038 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4728cd7-80b2-4e84-bc63-d854ff44d83d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:04.208251 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4728cd7-80b2-4e84-bc63-d854ff44d83d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:04.209810 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4728cd7-80b2-4e84-bc63-d854ff44d83d service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:04.218894 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 806/1634] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 21:49:05.002207 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d74eb-05be-4c82-8b2c-f8b3d68fe0a7 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:05.017123 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d74eb-05be-4c82-8b2c-f8b3d68fe0a7 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:05.029164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6429f28-49cd-413a-96bb-6e7e41e598ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6076b9f003c749348fcddef6f6ed28e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:05.030135 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6429f28-49cd-413a-96bb-6e7e41e598ee service placement] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:05.030638 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6429f28-49cd-413a-96bb-6e7e41e598ee service placement] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:05.031182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6429f28-49cd-413a-96bb-6e7e41e598ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:05.041064 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6429f28-49cd-413a-96bb-6e7e41e598ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:05.044031 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6429f28-49cd-413a-96bb-6e7e41e598ee service placement] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:05.056052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 829/1635] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:08.232769 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4728cd7-80b2-4e84-bc63-d854ff44d83d service neutron] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:08.250310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4728cd7-80b2-4e84-bc63-d854ff44d83d service neutron] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:08.254882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354516ed-2c92-4522-9bd7-20a56098ecf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:08.257863 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354516ed-2c92-4522-9bd7-20a56098ecf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:08.257863 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354516ed-2c92-4522-9bd7-20a56098ecf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:08.257863 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354516ed-2c92-4522-9bd7-20a56098ecf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:08.267985 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354516ed-2c92-4522-9bd7-20a56098ecf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:08.269511 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354516ed-2c92-4522-9bd7-20a56098ecf2 service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:08.286531 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 807/1636] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:12.007130 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01326be9-85af-4099-9b38-8de4063c4d2d None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:12.007584 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01326be9-85af-4099-9b38-8de4063c4d2d None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:12.007686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01326be9-85af-4099-9b38-8de4063c4d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:12.027479 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-01326be9-85af-4099-9b38-8de4063c4d2d None None] MFA Rules not processed for user `c84a9ca55a3f40d09e9e3097e09dfa22`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:12.029560 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-01326be9-85af-4099-9b38-8de4063c4d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:12.036690 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 830/1637] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:49:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:49:15.278903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9c9c5-45a2-47f1-a50e-425c9bac6d9c None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:15.279455 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9c9c5-45a2-47f1-a50e-425c9bac6d9c None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:15.279596 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9c9c5-45a2-47f1-a50e-425c9bac6d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:15.300620 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-aab9c9c5-45a2-47f1-a50e-425c9bac6d9c None None] MFA Rules not processed for user `586e22d3792b4759a38ab4c3bc12cf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:49:15.302149 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-aab9c9c5-45a2-47f1-a50e-425c9bac6d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:49:15.309759 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 808/1638] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 25 21:49:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:49:15.323057 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01326be9-85af-4099-9b38-8de4063c4d2d None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:15.335416 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01326be9-85af-4099-9b38-8de4063c4d2d None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:15.340975 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb3ad7-6510-411d-93d9-05c1ccc865e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4863a61a484ed4b0dac01e908cd05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:15.341627 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb3ad7-6510-411d-93d9-05c1ccc865e3 service swift] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:15.341905 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb3ad7-6510-411d-93d9-05c1ccc865e3 service swift] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:15.342355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb3ad7-6510-411d-93d9-05c1ccc865e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:15.350676 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb3ad7-6510-411d-93d9-05c1ccc865e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:15.352305 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb3ad7-6510-411d-93d9-05c1ccc865e3 service swift] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:15.360707 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 831/1639] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 21:49:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:49:20.171815 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9c9c5-45a2-47f1-a50e-425c9bac6d9c None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:20.188750 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9c9c5-45a2-47f1-a50e-425c9bac6d9c None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:20.195394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ee967-93e4-4417-af17-7b4db124ea7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:20.196137 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ee967-93e4-4417-af17-7b4db124ea7d service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:20.196413 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ee967-93e4-4417-af17-7b4db124ea7d service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:20.196683 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ee967-93e4-4417-af17-7b4db124ea7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:20.210052 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ee967-93e4-4417-af17-7b4db124ea7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:20.211815 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ee967-93e4-4417-af17-7b4db124ea7d service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:20.236023 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 809/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:25.357421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=42 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:49:30.221626 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=39 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:49:43.879972 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb3ad7-6510-411d-93d9-05c1ccc865e3 service swift] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:49:43.889421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb3ad7-6510-411d-93d9-05c1ccc865e3 service swift] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:49:43.893922 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23903fad-307a-4ef0-8ebf-5bf9fb53f11d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:49:43.898608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23903fad-307a-4ef0-8ebf-5bf9fb53f11d service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:49:43.898608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23903fad-307a-4ef0-8ebf-5bf9fb53f11d service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:49:43.898608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23903fad-307a-4ef0-8ebf-5bf9fb53f11d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:49:43.904431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23903fad-307a-4ef0-8ebf-5bf9fb53f11d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:49:43.905899 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23903fad-307a-4ef0-8ebf-5bf9fb53f11d service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:49:43.915833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 832/1641] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:49:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:49:53.911530 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=6 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:51:11.773333 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a341789-52ee-42e8-b354-201dd3dcfc5f None None] REQUEST_METHOD: `POST` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:11.773814 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a341789-52ee-42e8-b354-201dd3dcfc5f None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:11.773903 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a341789-52ee-42e8-b354-201dd3dcfc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:11.794065 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.auth.core [None req-1a341789-52ee-42e8-b354-201dd3dcfc5f None None] MFA Rules not processed for user `586e22d3792b4759a38ab4c3bc12cf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80308) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:51:11.795811 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-1a341789-52ee-42e8-b354-201dd3dcfc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:51:11.804310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 810/1642] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 25 21:51:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 21:51:11.848100 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23903fad-307a-4ef0-8ebf-5bf9fb53f11d service neutron] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:11.859236 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23903fad-307a-4ef0-8ebf-5bf9fb53f11d service neutron] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:11.864234 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6636536-8e38-494b-bea9-9bd89a10596d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c4863a61a484ed4b0dac01e908cd05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:11.864850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6636536-8e38-494b-bea9-9bd89a10596d service swift] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:11.865135 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6636536-8e38-494b-bea9-9bd89a10596d service swift] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:11.865412 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6636536-8e38-494b-bea9-9bd89a10596d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:11.873435 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6636536-8e38-494b-bea9-9bd89a10596d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:11.875007 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6636536-8e38-494b-bea9-9bd89a10596d service swift] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:11.882946 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 833/1643] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 25 21:51:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 21:51:12.685567 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a341789-52ee-42e8-b354-201dd3dcfc5f None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:12.695562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a341789-52ee-42e8-b354-201dd3dcfc5f None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:12.698875 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38a3b1-a428-4bb8-8c67-0c8db6e3539f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:12.699501 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38a3b1-a428-4bb8-8c67-0c8db6e3539f service neutron] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:12.699818 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38a3b1-a428-4bb8-8c67-0c8db6e3539f service neutron] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:12.700097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38a3b1-a428-4bb8-8c67-0c8db6e3539f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:12.763948 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38a3b1-a428-4bb8-8c67-0c8db6e3539f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:12.765393 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38a3b1-a428-4bb8-8c67-0c8db6e3539f service neutron] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:12.775037 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 811/1644] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:51:14.308082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fbb5e-f3f6-4309-ac20-15a419a85daa None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:14.308653 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fbb5e-f3f6-4309-ac20-15a419a85daa None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:14.308739 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fbb5e-f3f6-4309-ac20-15a419a85daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:14.329222 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-434fbb5e-f3f6-4309-ac20-15a419a85daa None None] MFA Rules not processed for user `2e2b38fe46634485acbaab1de5bb5a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:51:14.330441 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-434fbb5e-f3f6-4309-ac20-15a419a85daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:51:14.337394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 834/1645] 10.222.0.27 () {58 vars in 958 bytes} [Mon Jul 25 21:51:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:51:16.396450 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055a6d-d591-4bee-ba3a-3efd4c3c5e17 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:16.401514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055a6d-d591-4bee-ba3a-3efd4c3c5e17 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:16.401514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055a6d-d591-4bee-ba3a-3efd4c3c5e17 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:16.401514 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 812/1646] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 21:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 21:51:16.434270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f027dda-da9c-42b7-91cf-834531d7cf7b None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:16.434270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f027dda-da9c-42b7-91cf-834531d7cf7b None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:16.434270 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f027dda-da9c-42b7-91cf-834531d7cf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:16.451109 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-4f027dda-da9c-42b7-91cf-834531d7cf7b None None] MFA Rules not processed for user `6076b9f003c749348fcddef6f6ed28e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:51:16.452475 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-4f027dda-da9c-42b7-91cf-834531d7cf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:51:16.461538 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 835/1647] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 21:51:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:51:16.473433 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb055a6d-d591-4bee-ba3a-3efd4c3c5e17 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:16.487148 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb055a6d-d591-4bee-ba3a-3efd4c3c5e17 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:16.493310 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655f645-a95b-497a-ab4d-dab706a34ca1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6076b9f003c749348fcddef6f6ed28e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:16.493917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655f645-a95b-497a-ab4d-dab706a34ca1 service placement] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:16.503275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655f645-a95b-497a-ab4d-dab706a34ca1 service placement] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:16.503275 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655f645-a95b-497a-ab4d-dab706a34ca1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:16.504912 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655f645-a95b-497a-ab4d-dab706a34ca1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:16.506463 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655f645-a95b-497a-ab4d-dab706a34ca1 service placement] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:16.516810 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 813/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:51:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:51:21.192404 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f027dda-da9c-42b7-91cf-834531d7cf7b None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:21.199861 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f027dda-da9c-42b7-91cf-834531d7cf7b None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:21.205635 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:21.206291 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:21.206575 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:21.206850 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] PATH_INFO: `/v3/users/c84a9ca55a3f40d09e9e3097e09dfa22` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:21.208070 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84a9ca55a3f40d09e9e3097e09dfa22)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:21.209097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: WARNING py.warnings [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:51:21.209097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: warnings.warn(msg) Jul 25 21:51:21.209097 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: Jul 25 21:51:21.210303 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:21.408390 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84a9ca55a3f40d09e9e3097e09dfa22'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:21.428348 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84a9ca55a3f40d09e9e3097e09dfa22'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:21.428965 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84a9ca55a3f40d09e9e3097e09dfa22'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:21.429580 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84a9ca55a3f40d09e9e3097e09dfa22'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:21.488457 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84a9ca55a3f40d09e9e3097e09dfa22'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:21.504418 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 836/1649] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Jul 25 21:51:21 2022] DELETE /identity/v3/users/c84a9ca55a3f40d09e9e3097e09dfa22 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:51:21.747519 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655f645-a95b-497a-ab4d-dab706a34ca1 service placement] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:21.758289 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655f645-a95b-497a-ab4d-dab706a34ca1 service placement] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:21.816803 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:21.817466 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:21.817754 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:21.818035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] PATH_INFO: `/v3/projects/b08e2704cd264b6b8096da68b310420b` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:21.819226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b08e2704cd264b6b8096da68b310420b)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:21.820307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: WARNING py.warnings [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 21:51:21.820307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: warnings.warn(msg) Jul 25 21:51:21.820307 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: Jul 25 21:51:21.821528 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:21.923394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b08e2704cd264b6b8096da68b310420b', 'request_id': 'req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:21.929342 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b08e2704cd264b6b8096da68b310420b', 'request_id': 'req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:21.979711 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b08e2704cd264b6b8096da68b310420b', 'request_id': 'req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:21.998701 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] The token cache is being invalidate because project b08e2704cd264b6b8096da68b310420b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80308) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 21:51:21.998994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:21.999639 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:22.001196 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 814/1650] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Jul 25 21:51:21 2022] DELETE /identity/v3/projects/b08e2704cd264b6b8096da68b310420b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:51:22.005146 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:22.006542 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:51:22.020284 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219adf0-2687-4aca-a7eb-6c6e0ca95961 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:22.076813 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf3d6b-e8b2-4641-9539-25b32387ce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:22.077455 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf3d6b-e8b2-4641-9539-25b32387ce27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:22.077741 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf3d6b-e8b2-4641-9539-25b32387ce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:22.078018 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf3d6b-e8b2-4641-9539-25b32387ce27 admin admin] PATH_INFO: `/v3/users/2470de33312e49d98e36a5b83f483864` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:22.079190 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf3d6b-e8b2-4641-9539-25b32387ce27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2470de33312e49d98e36a5b83f483864)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:22.081154 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf3d6b-e8b2-4641-9539-25b32387ce27 admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:22.233793 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f6bf3d6b-e8b2-4641-9539-25b32387ce27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2470de33312e49d98e36a5b83f483864'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:22.234841 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:51:22.246554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f6bf3d6b-e8b2-4641-9539-25b32387ce27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2470de33312e49d98e36a5b83f483864'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:22.247253 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f6bf3d6b-e8b2-4641-9539-25b32387ce27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2470de33312e49d98e36a5b83f483864'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:22.247981 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f6bf3d6b-e8b2-4641-9539-25b32387ce27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2470de33312e49d98e36a5b83f483864'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:22.293445 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-f6bf3d6b-e8b2-4641-9539-25b32387ce27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2470de33312e49d98e36a5b83f483864'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:22.305830 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 837/1651] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Jul 25 21:51:22 2022] DELETE /identity/v3/users/2470de33312e49d98e36a5b83f483864 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:51:22.564993 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:22.566431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:51:22.577214 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:51:22.581383 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2308c-63f2-4e80-9836-8c8c2f75eb0b admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:22.647608 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:22.648297 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:22.648612 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:22.648893 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] PATH_INFO: `/v3/projects/d1a04803a12845ddb497ca0d212b424a` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:22.650084 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1a04803a12845ddb497ca0d212b424a)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:22.652132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:22.736093 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1a04803a12845ddb497ca0d212b424a', 'request_id': 'req-47243453-8454-492c-b8cf-0f851b06e0e9'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:22.742351 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1a04803a12845ddb497ca0d212b424a', 'request_id': 'req-47243453-8454-492c-b8cf-0f851b06e0e9'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:22.785562 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1a04803a12845ddb497ca0d212b424a', 'request_id': 'req-47243453-8454-492c-b8cf-0f851b06e0e9'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:22.798232 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] The token cache is being invalidate because project d1a04803a12845ddb497ca0d212b424a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80308) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 21:51:22.799179 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:22.799330 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:51:22.800797 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 815/1652] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Jul 25 21:51:22 2022] DELETE /identity/v3/projects/d1a04803a12845ddb497ca0d212b424a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:51:32.379651 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=12,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:51:32.795063 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:51:40.502935 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf3d6b-e8b2-4641-9539-25b32387ce27 admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:51:40.504431 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-f6bf3d6b-e8b2-4641-9539-25b32387ce27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:51:40.650327 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf3d6b-e8b2-4641-9539-25b32387ce27 admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:51:40.711321 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b565ed8-1557-4ecb-85f4-61c6186b8e99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6076b9f003c749348fcddef6f6ed28e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:51:40.711984 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b565ed8-1557-4ecb-85f4-61c6186b8e99 service placement] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:51:40.712273 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b565ed8-1557-4ecb-85f4-61c6186b8e99 service placement] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:51:40.712554 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b565ed8-1557-4ecb-85f4-61c6186b8e99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:51:40.714723 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3b565ed8-1557-4ecb-85f4-61c6186b8e99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:51:40.725812 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b565ed8-1557-4ecb-85f4-61c6186b8e99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:51:40.727425 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b565ed8-1557-4ecb-85f4-61c6186b8e99 service placement] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:51:40.737241 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 838/1653] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:51:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:51:50.733254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=89 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:53:15.714345 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:15.718579 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:15.846156 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47243453-8454-492c-b8cf-0f851b06e0e9 admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:15.851970 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f21dc-d240-422b-a022-0f6dcaf8ada3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d3d6613476c445b82302df5025f3ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:15.852631 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f21dc-d240-422b-a022-0f6dcaf8ada3 service nova] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:15.852917 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f21dc-d240-422b-a022-0f6dcaf8ada3 service nova] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:15.853195 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f21dc-d240-422b-a022-0f6dcaf8ada3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:15.855029 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-8a8f21dc-d240-422b-a022-0f6dcaf8ada3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:15.867442 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f21dc-d240-422b-a022-0f6dcaf8ada3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:15.869076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f21dc-d240-422b-a022-0f6dcaf8ada3 service nova] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:15.879439 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 816/1654] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:53:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:53:25.876588 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=57 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:53:31.332526 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b565ed8-1557-4ecb-85f4-61c6186b8e99 service placement] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:31.333994 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-3b565ed8-1557-4ecb-85f4-61c6186b8e99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:31.413672 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b565ed8-1557-4ecb-85f4-61c6186b8e99 service placement] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:31.417420 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6718116-f38e-43bf-95f7-abb229440c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b428f7d0d62049cf8fbbd05830d0d356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:31.418035 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6718116-f38e-43bf-95f7-abb229440c8c service neutron] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:31.418320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6718116-f38e-43bf-95f7-abb229440c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:31.418598 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6718116-f38e-43bf-95f7-abb229440c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:31.420371 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-c6718116-f38e-43bf-95f7-abb229440c8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:31.504106 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6718116-f38e-43bf-95f7-abb229440c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:31.505571 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6718116-f38e-43bf-95f7-abb229440c8c service neutron] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:31.527306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 839/1655] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:53:38.754817 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179ff3-4ca2-4da2-9b27-2eea723cb657 None None] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:38.755320 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179ff3-4ca2-4da2-9b27-2eea723cb657 None None] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:38.755424 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3179ff3-4ca2-4da2-9b27-2eea723cb657 None None] PATH_INFO: `/` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:38.756870 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 817/1656] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 25 21:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 21:53:38.782306 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474acc9-aceb-461e-b2b2-1ef624be60d9 None None] REQUEST_METHOD: `POST` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:38.782794 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474acc9-aceb-461e-b2b2-1ef624be60d9 None None] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:38.782794 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474acc9-aceb-461e-b2b2-1ef624be60d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:38.842591 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.auth.core [None req-8474acc9-aceb-461e-b2b2-1ef624be60d9 None None] MFA Rules not processed for user `6076b9f003c749348fcddef6f6ed28e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 21:53:38.843953 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8474acc9-aceb-461e-b2b2-1ef624be60d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:38.853540 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 840/1657] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 25 21:53:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 21:53:38.864658 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3179ff3-4ca2-4da2-9b27-2eea723cb657 None None] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:38.867394 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-b3179ff3-4ca2-4da2-9b27-2eea723cb657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:38.884521 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3179ff3-4ca2-4da2-9b27-2eea723cb657 None None] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:38.891932 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a176a04-5613-4ac1-9d66-0ffb2e80b44b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6076b9f003c749348fcddef6f6ed28e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:38.892604 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a176a04-5613-4ac1-9d66-0ffb2e80b44b service placement] REQUEST_METHOD: `GET` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:38.892890 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a176a04-5613-4ac1-9d66-0ffb2e80b44b service placement] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:38.893182 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a176a04-5613-4ac1-9d66-0ffb2e80b44b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:38.897355 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474acc9-aceb-461e-b2b2-1ef624be60d9 None None] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:38.899075 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-8474acc9-aceb-461e-b2b2-1ef624be60d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:38.905833 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a176a04-5613-4ac1-9d66-0ffb2e80b44b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:38.907423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a176a04-5613-4ac1-9d66-0ffb2e80b44b service placement] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:38.915082 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474acc9-aceb-461e-b2b2-1ef624be60d9 None None] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:38.919054 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 818/1658] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:53:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:53:38.919863 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4904e5-df32-4942-a2af-52795768e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:38.920512 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4904e5-df32-4942-a2af-52795768e36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:38.920795 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4904e5-df32-4942-a2af-52795768e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:38.921073 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4904e5-df32-4942-a2af-52795768e36a admin admin] PATH_INFO: `/v3/users/2e2b38fe46634485acbaab1de5bb5a10` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:38.936101 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4904e5-df32-4942-a2af-52795768e36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e2b38fe46634485acbaab1de5bb5a10)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:38.938336 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4904e5-df32-4942-a2af-52795768e36a admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:38.944525 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=100 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:53:39.158423 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9d4904e5-df32-4942-a2af-52795768e36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e2b38fe46634485acbaab1de5bb5a10'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:39.171010 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9d4904e5-df32-4942-a2af-52795768e36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e2b38fe46634485acbaab1de5bb5a10'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:39.171777 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9d4904e5-df32-4942-a2af-52795768e36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e2b38fe46634485acbaab1de5bb5a10'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:39.172401 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9d4904e5-df32-4942-a2af-52795768e36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e2b38fe46634485acbaab1de5bb5a10'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:39.253824 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-9d4904e5-df32-4942-a2af-52795768e36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e2b38fe46634485acbaab1de5bb5a10'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:39.267566 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 841/1659] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Jul 25 21:53:38 2022] DELETE /identity/v3/users/2e2b38fe46634485acbaab1de5bb5a10 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 21:53:39.548282 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a176a04-5613-4ac1-9d66-0ffb2e80b44b service placement] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:39.559107 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a176a04-5613-4ac1-9d66-0ffb2e80b44b service placement] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:39.618402 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:39.619039 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:39.619318 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:39.619590 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] PATH_INFO: `/v3/projects/43e0650870cb41489254ce1cf893230e` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:39.629734 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e0650870cb41489254ce1cf893230e)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:39.632573 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:39.775688 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e0650870cb41489254ce1cf893230e', 'request_id': 'req-31b7f397-de84-4aae-ad7c-b929034982f4'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:39.781141 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e0650870cb41489254ce1cf893230e', 'request_id': 'req-31b7f397-de84-4aae-ad7c-b929034982f4'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:39.846698 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e0650870cb41489254ce1cf893230e', 'request_id': 'req-31b7f397-de84-4aae-ad7c-b929034982f4'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:39.858717 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] The token cache is being invalidate because project 43e0650870cb41489254ce1cf893230e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80308) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 21:53:39.859004 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:39.859622 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:39.861203 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 819/1660] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Jul 25 21:53:39 2022] DELETE /identity/v3/projects/43e0650870cb41489254ce1cf893230e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:53:39.865372 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4904e5-df32-4942-a2af-52795768e36a admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:39.866987 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-9d4904e5-df32-4942-a2af-52795768e36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:39.880226 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4904e5-df32-4942-a2af-52795768e36a admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:39.939686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed63a38-2eff-48c0-bc49-8f8b404ace3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:39.940366 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed63a38-2eff-48c0-bc49-8f8b404ace3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:39.940654 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed63a38-2eff-48c0-bc49-8f8b404ace3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:39.941044 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed63a38-2eff-48c0-bc49-8f8b404ace3c admin admin] PATH_INFO: `/v3/users/4665849d19fe495381931a3aad470b7c` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:39.955563 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed63a38-2eff-48c0-bc49-8f8b404ace3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4665849d19fe495381931a3aad470b7c)` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:39.957657 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed63a38-2eff-48c0-bc49-8f8b404ace3c admin admin] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:40.146184 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-5ed63a38-2eff-48c0-bc49-8f8b404ace3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4665849d19fe495381931a3aad470b7c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:40.158212 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-5ed63a38-2eff-48c0-bc49-8f8b404ace3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4665849d19fe495381931a3aad470b7c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:40.158882 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-5ed63a38-2eff-48c0-bc49-8f8b404ace3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4665849d19fe495381931a3aad470b7c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:40.159493 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-5ed63a38-2eff-48c0-bc49-8f8b404ace3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4665849d19fe495381931a3aad470b7c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:40.248266 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.notifications [None req-5ed63a38-2eff-48c0-bc49-8f8b404ace3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4665849d19fe495381931a3aad470b7c'} {{(pid=80307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:40.253199 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:53:40.262398 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 842/1661] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Jul 25 21:53:39 2022] DELETE /identity/v3/users/4665849d19fe495381931a3aad470b7c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:53:40.535646 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] Authenticating user token {{(pid=80308) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:53:40.542188 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.fernet_utils [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80308) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:53:40.550545 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7f397-de84-4aae-ad7c-b929034982f4 admin admin] Validating token access rules against request {{(pid=80308) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:53:40.613034 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e0854-e88d-4352-ad0f-0f45d70dbfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d88c6eac2e460ca7e17f398e2ce9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e47334e4e95e4979a35529036ec99feb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80308) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:53:40.613686 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e0854-e88d-4352-ad0f-0f45d70dbfc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:53:40.613969 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e0854-e88d-4352-ad0f-0f45d70dbfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:53:40.614244 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e0854-e88d-4352-ad0f-0f45d70dbfc7 admin admin] PATH_INFO: `/v3/projects/d17f535422574d028695b8c23ef5372c` {{(pid=80308) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:53:40.625518 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e0854-e88d-4352-ad0f-0f45d70dbfc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17f535422574d028695b8c23ef5372c)` {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:53:40.627460 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e0854-e88d-4352-ad0f-0f45d70dbfc7 admin admin] RBAC: Authorization granted {{(pid=80308) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:53:40.628951 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:53:40.758513 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-030e0854-e88d-4352-ad0f-0f45d70dbfc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17f535422574d028695b8c23ef5372c', 'request_id': 'req-030e0854-e88d-4352-ad0f-0f45d70dbfc7'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:40.763975 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-030e0854-e88d-4352-ad0f-0f45d70dbfc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17f535422574d028695b8c23ef5372c', 'request_id': 'req-030e0854-e88d-4352-ad0f-0f45d70dbfc7'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:40.836956 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-030e0854-e88d-4352-ad0f-0f45d70dbfc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17f535422574d028695b8c23ef5372c', 'request_id': 'req-030e0854-e88d-4352-ad0f-0f45d70dbfc7'} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:40.848974 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-030e0854-e88d-4352-ad0f-0f45d70dbfc7 admin admin] The token cache is being invalidate because project d17f535422574d028695b8c23ef5372c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80308) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 21:53:40.849783 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-030e0854-e88d-4352-ad0f-0f45d70dbfc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:40.850495 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG keystone.notifications [None req-030e0854-e88d-4352-ad0f-0f45d70dbfc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80308) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 21:53:40.852164 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: [pid: 80308|app: 0|req: 820/1662] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Jul 25 21:53:40 2022] DELETE /identity/v3/projects/d17f535422574d028695b8c23ef5372c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 21:53:50.373519 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=3 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:53:50.849900 dv-osbrick-849018-3-iscsi devstack@keystone.service[80308]: DEBUG dbcounter [-] [80308] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 21:56:43.486069 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed63a38-2eff-48c0-bc49-8f8b404ace3c admin admin] Authenticating user token {{(pid=80307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 21:56:43.487464 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-5ed63a38-2eff-48c0-bc49-8f8b404ace3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:56:43.556103 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed63a38-2eff-48c0-bc49-8f8b404ace3c admin admin] Validating token access rules against request {{(pid=80307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 21:56:43.615132 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8363b1d-e281-421b-b3df-5c9d8c9704cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6076b9f003c749348fcddef6f6ed28e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c81feed744bb9e322910711a0d3b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 21:56:43.615784 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8363b1d-e281-421b-b3df-5c9d8c9704cd service placement] REQUEST_METHOD: `GET` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 21:56:43.616076 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8363b1d-e281-421b-b3df-5c9d8c9704cd service placement] SCRIPT_NAME: `/identity` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 21:56:43.616356 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8363b1d-e281-421b-b3df-5c9d8c9704cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 21:56:43.618421 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.fernet_utils [None req-a8363b1d-e281-421b-b3df-5c9d8c9704cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 21:56:43.629254 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8363b1d-e281-421b-b3df-5c9d8c9704cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 21:56:43.630854 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8363b1d-e281-421b-b3df-5c9d8c9704cd service placement] RBAC: Authorization granted {{(pid=80307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 21:56:43.640751 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: [pid: 80307|app: 0|req: 843/1663] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 25 21:56:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 21:56:53.636735 dv-osbrick-849018-3-iscsi devstack@keystone.service[80307]: DEBUG dbcounter [-] [80307] Writing DB stats keystone:SELECT=58 {{(pid=80307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}